(i9)H#B#fFff (jp) (12) ^ p| |g (a) {nmnmwAmsn 

#Hf!¥9- 171448 

(43)&WB 9 ^(1997)6^300 

<5Dinta* mm** fttommm* fi mm*mm 

G 0 6 F 3/14 3 4 0 G 0 6 F 3/14 3 4 0 A 



S*»3R ffif*««D«tl OL 44 H) 



(21)UJH»# 


«BPF8-288851 


(71)ffl«A 


590000798 














(22)/IIKB 


¥^8^(1996)10^303 




XEROX CORPORATION 










— a— a— 14644 


(31)«ifc*fcl3BflM§ 


5 5 2 6 6 3 








(32)«5fcB 


1995*f 11/i 3 B 










*B (US) 


(72)5691* 


1 — VX • t?- 




















94301 /tD7JVh i^U— >«>^H7"^ 








-zl— 1037 








(74) ^SA 














«*Hfc*< 



(54) a^fa-^Uil^X^W^fA 



(57) [Sift] 

im&^m fu^M osn^^ ypw^ 

XTl^ A com 2 y H -><?)^ A =7 4 >lz \Z*J a. 
fttBKJfc tTSfS 1 tm2c7)T> -f >- jSfrTSJL— r 



5— 




H) 



7^ 



\ 



7" 



(2) 



1tm^9-l 7 1448 



mtf * xrw yxfAtJ>-5t, mi&mco* =Ta 
(MfflfflT-* 4 xrW xXxA#ijirfB-fe -y x 3 >-$rs*-r 

a-— twtriBny e jL—ffflwgi74 xrw 

? 4 AX b »J -A 1 4 ^y h t> c7) t % 

4 AX h U-A*>^7-V XTW fl»B^»tS*4fcft 
c^t**^T f -fTx5ji.P-v-3>'|llSST"$)-p-r. fl 

ibjs 1 <r>^ < y vw. mo&imm* -r •< rr?-* 
y^-Bswsriiff zmmizm^-t h fztboyu-^ 

t LT, B-rlB-fe -yxHy^m^^Iffll-t-S.^O 
a.— f 4 ^7i-xt LT«t^-& tot . 
B!ilB7-'4X:rWtf>Jg2tf)'> -f VY*7<r>94 A^-f y\,Z 

£.z*khiz*h<r>?4 2*74 yft±mmx'$>r,x . ifrfBt' 

5**77M yi^-?^#**M^y M^JSLTTtirlB 
tvyj y\tf>— B^Sr^f y-f-y ? x£frT i><7>b , 
HiriEU 1 o^ -f y H^ScV^imrlfi^O^ ^ y K«7cov* 

7x = * u— x 3 yiasst iwa^-f a ^-f y^sss 

co&*lzm-&fflfflm^£%;!iL2-£. ffilB-x-^fflS 
f^ffl^E tTMiam 1 o«> y b^i: M12m2<7)'> -f y 

[000 1] 

[0 0 0 2] 

tz S — f ^ y^«t 3 SrSSSfut-fc -y -f < yftfifrMi 

x^&m&xzt. &mizj:&wm<7>^iob o^id^ 



$>&im : £&miz®M-rz>c\b&?zz>. zntn^T 
0 . r>v-T& 5 \,z^tit><rymmzm ttzfrt ^ 

oZtlz^Xteftt'teft-t&ayVA-fmmcvy- 
MZ£~>Xli-HHZ\ty*-hZtiX\i^%\<\ MK> 

ktx. mmzmmw.Mv-Mzm'&&8:^Ji-mzm 

h*thH&%:t%~?X\->h. 

[0003] S-^-r >yn*—*f4 b'-r*. a 

yxA-^r^-fex^Jt^ca^Sg^ffirfei*^^^. * 

^fflT'fts. m-ox. mmzft^mmwo-hizm 
(i. <mx$>'om£L^ztx'h&. . 

[00 04] -f y^vfz.Z-ttft&zt'w— OCOTT 

Time notetaking) tS^it^. -?-L 

Ati, ;-v<7m>z<r>m«<rmmz94 a 
x^yTTs^xT-ASrflEfflLT. s— f-^ yv^miz 
^fiti. 5-^^ y^iBii^oiiMnr 
^^yx>y^xsrffi«^-f,„ y-hcoesco^^m 
CStRfl.c:i:tcJ:o-c. v-x^Atiy-bS*o^-< 
Ax^yricMK-t&AVie^ogB^^, ^UTW^ 

[0005] StftMi&CTii. jt<0*?yXfAt* 
0. zzx-ii. a— y^'Jitftc^T 

drXKoxhuy^^^O. ^-f Ax^yy^ix^y 
-hS*<i, ^xhoffl-f? (nsc^xh /-bf- 

vx'% . 5 -x -< y^ffin^jE-rsgp^^^ixT 

[00 06] y-h^-^yiy-^XxAti. JL-if*s« 
y-r-y^Xi: LTflStgSrSJt"t. #«£0>f yf-y 

fi. zL-^t^K^^Ltz^mx'hh. #*^yf 
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[0007]/- hf-* yyisxrMi, mim^ 
menmrntf. A^yhz&s.-t&mmn^-T-yxnn. 

(«*t$>ot, A j <.ybX'i±%:^ztT$>&. 

[00 08] 

s T7 u-^-ffp^n d^jftji. a*v- h t" — y ^<ott 
-v^-^yy^mzm^^^x', %-f<yy 

[0009] 

•So * <0 J: o ft-mm?- 9 (i » — ?Jfi v 4k<Hl£LhO 
*+:r*-ir«* (Mil*, ^-r-f^-fOifiH^v^im^ 

tt, 9A iXhiJ-At^hH**. iMAXb 

h<0^>f J*A9y7Zti.*i'r— 9T&&. r 

ttfh<9. A^ybZmWhtzMzfttfZti 
ztg&tfhz. A^ybmtit. 9A^x9yy. A< 

>-ML &V\ A Oh <DAyx 9yxcr>mxnn<&fr 

[00 10] -b -y ^ a yconmt. <tyyayT9*:X 
mW<7>fflffl<7)TX"+T%£>tl& „ 9 A J»X V 'J - A £ S± 

mi.*mm+&KLib<7>3--' va y9-? ^-xi&fct 
ztzMzA^ybftmzmm-tz. 

-x<4, M^^^KlSI.. ^co^yF^ 
IWJffliJIS, 2*:(4, if^ (rfi 

h.-K-HliRKfc-fe >y i^3 yc0i?£$:»?-£ 



KUO^ yF^fcfcWCUL m^VA Ftf-FSIS 

yF (fl^tf, ^^yhM, ^yhe> -f^yF 
A<yhii.m2<D^^y} i 'y<7)9AM.yAyco±X' 

mmZilZ. miz. 9A AyAy^^t yVVc0t'>>3.T 
>VA yi?7--9tfmiZtlhtZ . mi<W < yVW 

WS-JMttt. WfabSflMRi^tfTft^-J-b-y^ay 
[00 11] 

iwmmsfomm mm. ^mt^m^xmm 
%mMmiz&H%-&m7-9<m®mm±<ntz#> 

£xnim%m&mnt,z}3^x* m-tz i fc s-fe 

>y x 3 >-r ^ -fe^. V- ^ Xf-y 3 yco^n >y ^HT * 

m3u. *mi<Dm&)&x'<r>im%mffi&m<?>* y 

M^aico-b y ^ 3 yco^<7)^^f y^L-VA y9 
—ys.—x^^xyv-A<omx'hh. m6i±. MWftffl 
h?v9TJXy\sA3:0TbM£J%fflh7v9T<X 
7UA3LVT(DfflffiZs\A7A h*r&9A£.7AyAy 

9-y^-xff)sm\t^tu-cmx'hh. mm. 06o 

$-^-tHT'S»S. H8Ji. Hoco-fc y a y<rm%L*U 
mthtzih<r>9A^Ay^-~^fA y9—7 i-7f-( 

^n*ra h77?iy t##* o^-fe 

*-kts9A ^A yA y9-7*—x<nmx'fo&. mi 

0{±. m9(DM£Mmb7-y9^VT<?>y-A XmiEWtk 

mzK-f9A2±7AyAy9-7 3.-x<r>mx'hz. m 

1 114, Li veBoard>>^yh'>7COStRl!>f^c7)3g 

^-^^«T*ieiiL7t-b >y ^ 3 y<os^co7ttf5«o^'f a? 

-fM y^ — 7x-X^PJT'3il). HI 2»4, — 3 cob 

; y-/9<r>±.X'mi \<r>*-f i ytcnv^ v 9 ZW^sLK 
t&3k£7jki-9A A.JA y3--VA y^-7i-if« 
T^-^cOS^SHT'ftS,, 013«4. /-M- 9 
±lcy-b S-^tt^*Sr*fEI 1 1 co^^ J*?A y=L 
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— <f A y?-7 x -xf-'-r xrw coM%hmx-$> & . 
-7M vrrv— Tnmx'hh. mi 5<i, ^"josi 

^T^»3i^llStS«^*3(tS LiveBoard-) 
>f yK^HTfcS. 01 6fS. LiveBoard^ 
4 >- K*7i: :M A7>f W i^-^x-XOPal^fflMtt 

cnmx-bh* -t^:t>*>, yjyj -vmT'Vx.Vbfrh 
94J±7-< y\r>4 yf ••/ ? xmfX'fo 4 . H l 7 li, 

Li veboard^^yK^i^^A^^f^y?- 
7i-^mWWftWitl>5. -f3r;b*>. Live 

7°U->iW&X°fo&. 018li. Liveboard^-f 
y H *J 1 9 A A7 -4 W —7 x— X«WHtt(7) 
0T&&,> — ^&&<D*>&£ia<0'VC9-<f V 

?Xfttn-£S . 0 1 9 li. LiveBoard'7 

4 yWb?4 A5>f w y?— 7x-x^<7)ffiM1± 
<O0T-$>&. -T^t)*). /57^ ■y^^T'yx? MCO 
££§&<7M^hT'&&. 02 01! LiveBoar 
d»7-r yb^tfJ^J y-i~y?— 7 x-Z.cr>f3<?)1& 

m&<7)mmx*h & . -r^fc^ . *tvx ? h ^ r^er 
w&tzx^x^t y"r-y7xzmi&. 0212W02 

2J! LiveBoard7^ K*J&*«fcS*lfciHr» 

<r> "i^yisyf-it—iV B±^-Ktct>(tSL i v 

e B o a r d^7 ^ > H^cOCTSrSltt-r^ „ 
[0012] *JWJIi, 5-f-O/<0J:a fcftBfl* 

[00 1 3] *^BH^aw{±, im j t<oi><7)<o&m%:m 
&wx'h&&mftM<?>$- : r 4 y-7im^4 yf-/ ?x 
*>&&-Th^tx°jhh. cixtt A«mmztifz-t-> 
^3 y<D-&wmtT?*x$ft&mmfcim ! £:m 
ts-rs. mm<7>$3i. b#-b<\<7>m%ikx-ms 

~?-*y?mt. y-hZMZztcDXiZj^yb 

e ?&(vw\mac?>mx'$> s . 

[0014] *?HB<?)yXfA|±, V7 h7i7l:S^ 

-*7^^<±, m$&x-nim%mffim i mffzti 

SV7h^iT7l'-A7-?^5„ xXfAT- 

[0 0 15] AX h ij - ASV^f AT-^ff ^ 

[0 0 16] NAXh'j-A (Timestrea 

fife* T 4 7f- * SrS* L . 7U— T-X'W±~t h Z 
btfX'*Z. 

[0 0 17] 4<yb (Events))! Sf#£*l£ 

mi<r>?$<r>i&%&*tz\mmx'm.-t znum. mi 



4. 

[0018]-^Wf-^ (Tempora I Dat 
a)ii, *M AXhy-Afc^yNc^rt^S^ 

[0019]-byv-3>-{Sessions)(i, 5 — 

r < y^coi 3 izmm lt®*§s *ifeia»s:ieB , r6- 

[0020] (Players)ti, -e<7)7Ctf> 

[002 1 ] If-f^ (Editors)ll t*iot.T 

'sybi^-fAXh'J-AS-fe'yya MCftfllTt & CI i: 
*<T'# & A y? —7 x -x 5rS#-f & . 
[0022] H£ittffllg|S (Playback Con 
trollersjii.-b-yv-g >-i?)H±^$IJffll$tl.4 

tm ^-7i -xsrmw-r S . 

[0023]^ J p7'frlll(Capture Dev 

icesiii. -mm^-^imnLxwm^^mmx' 

[00 24] ^>fAXh'J-Ar-^f?fA'(t IHfP 

mmzyx-b-tz, ztiiz. n^<r>-7^y<7)~^>coT 

u Km" ^-^x^h$r^-ri»^^x^h$-, 
i?hyxfAcs^^>-^. z<7)ft®m*7'i;x.? 

b y^f^l! MlaOM - " (Inter — Langua 
ge Unification) ( I LU ) fcffc^il. 
JanssenCiS " I LU?-a?;P" 
X^#8S#, ISTL-CSA-94-01-02, 
1 9 94^1^(C^^>iXTV>S. ;^AXh'J-A7 

[0025] -f^Mi, MM^n, mmc my 

b' ■Kyblz-o^Xii&ftlia) . S.?/. S^«c 

LiveBoard'^-y'f^yHi ' 

fc' #145:*^*^Lix=5:V\ ) <i«.y 

Wyx^b^y^x-XIl OT^J:o(c 

TYPE Event=CLASS 
SUPERCLASS P e r s i s t e n t Ob j e 
c t END 
METHODS 
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getType () : St r i ng, 
getStartTime () :Time, 
getDurat ion () : Time 
END 

[0 026] :;t^^>f^-7x-xttf 
m*< . jj-tv* 9 vm^-m^^ s >?zma lx 

ersistentObjec t <W7 9 7 X t LT. 
4 MiOT^^^S Hffi< 
getPropertyNames () : String 
Sequence 

setProperty (name: String, v 
alue : String) 

getProperty (name: String) : 
String 

[ 0 0 2 7 ] 4 Mi, £rFtC&<fc i^K, -fe y v- 
[0 0 28] NAXh'J-A^yx^Ki. m&co 

TYPE Timestream 
SUPERCLASS Pers 
METHODS 

me d i aTyp e ( ) : S t r 
format () : String 
startTime () :Tim 
duration ( ) :Time 
END 

[0029] *7^a>tt> ^AXhU- 
T^t'II- Mi Win i: m&t hf—9<^Wk\ ' -fe 

•y^g/ li^S'j&^-s-c* -?> ^ i: (casw- T'ft 

y'x^NM)^^-?!-^! felT^i o%i><DX 
. 

TYPE Session = CLASS 
SUPERCLASS PersistentObje 
c t END 
METHODS 

g e t T i me s t r e am B y N am e (name: 

String) :Timestream, 

getAl ITimestreams () : T i m e s 

TYPE Player=CLAS 



?m.z*imz-?&. mmtifz^-^^<DXoi,z. 
t^-tzb^X'^tzf-^m^yr^f-^^m. 

lzmt?i-&y->7°>l'Ztitz J r-?c?>ffimii. ?4J*Ah 

•j— i*?: ' ^m?n' t%z>ztz-mm<mmizTtz>. -t 
-f r 1 7 * - v -y r t mm lx \* *4«r»sr v-)V 

^^X<r>wmWkft*ivh„ mz, 1/3 

^htcioTw^sits. mane >f^bSrffoaj-r 

SWfc* t* ) ^AXh'J -At7y'i ? I- Sr^Bflt L 

^UXh'J-A«, ^-raHfcWi*** X'h Sffiffi 
£d*.*:V:? r>7xTi:, t— 7°<y->KJ46i:M^Wt^it 

y-A^yx? r^HX^-^x-Xii. J^TOil 
= CLAS S 

i stentObj ect END 



i ng, 



g . audio 
sun a u 



tream Sequence, 
getSessionByName (name:Ses 
sion) : Session, 
getAl lSessions () : Session 
Seque nee, 

createEvent (start : T i me , du 
r:Time, type: String, props: 
PropertyList) :Event 
END 

[003 0] ^^AXh'J-AT-^f^f+li, TV 

^&&mco4 x-xz^LXteO . if 
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METHODS 

seek(t:Time), W&mffl* t l<Z^-?& 

location () :Time, fi*r<Z>?f£IISHN;:R5 
P lay(s:Speed), M«stmtl> < 1 =SMt> 

s t o p ( ) , WktWitth 



attach (timestre 
END ; 

TYPE Recorder=C 
METHODS 
record ( ) , 
P a u s e ( ) , 
createRe cord i 
name: Name) :Timest 
f inishRecordi 
END ; 

[003 1] mfe&xy** rfflfcowcwix— Vi; u 

ediaServer' K<koT*»3i'L&, S£*> #T 
UvX^Tfflfclhtf— *U^Me d i 

%tzMZi£m&4 ^-7x-^) C935<ftfcfc#gi:3 

tvfr^o dixit inmcoTyv^-i/B > mta. ib 

§ 0 MediaServe r h'ViTM >-^ — 

So 

TYPE MediaServer= CLASS 
METHODS 

getRecorder (format : Strin 
g , context : String) : Recorde 
r , 

getPlayer (f ormat : String, c 
ontext : String) :Player 
END 

[0 0 3 3] T^rvA *fl±. -^m^^rim±(0^^ 



am:Timestream) J*ft/*ICD? 
LASS 



ng (sess ion : Session. 

ream, 

ng () , 

TYPE Ana 1 yze r = CLASS 
METHODS 

produceEvents (sess ion : Ses 

sion, specs: String) 

END 

[0 0 34] ©f^-b-y^g VtfO^-fA 

fiSULTr^^^lfCiOr^-b^^ii-S. 'spec 

ftsjKK-f o h s^flE-r**— f <t *<nv- warn 
i ) iz j: o ' mm' -rs i t **t§ § . 

[0035] 30&^i4£jgfc{5jt-f T-df 
tf>cOjSW&M e diaServers Zffi&.'t&y'u— 

iffi£.<D*7zSx 9 t-M (0)i(f*-f^<OM e d i 
a S e r v e r ) SrHSIU RV/XIZ. ZtlhWxn 

\zx t mmizm ozt sat. yu-^^ 
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tlh 

Type Broker=CLASS 
METHODS 

getMediaServer (media: Stri 
ng) :MediaServer 
getAnalyzer (type: String) : 
Ana 1 y z e r 
END 

[0036] A^h'J-A > JBOf. -fey 



[0037] smn- Kfc±*ww**Tr y ^--v 



session=master. getSessionByName (' R 
ecordings' ) 

b r o k e r =ma s t e r . getBroker () 

mserver=broker. getMediaServer (' aud 
i o' ) 

recorder=mserver. getRecorder (' mu 1 
aw ' , 'default audio device') 

recorder. createRecording (session, 
recordingl' ) 

recorder, record () 

. . . &&n-F(i. imtfX-X. l/^-A. m^li. xTT'fo 

recording, finis. hRecordinsO 
exit 



[0 0 38] m^mu^-vyy^^yhii. ie#§fc 

Vf\$tl&WP?&-t-yi'3y<7)" recording 

i" t%,ttvt>ixtt-?<t*imz4im 

mtZtlZXT-y 7 ^kB^S . 
[0039] £»£H£*4fctf>ta&S&*«:i-- H 

. . . VX^-fcffliM hy/l/W'fAXMJ 

session=master. getSession 
ByName (' Recordings' ) 
timestream=session. getTim 
e s t r e amB y N am e (' recording 
1' > 

broker=master. getBroker () 
m s e r v e r = b r o k e r . getMediaSe 
rver (' audio' ) 
P 1 a y e r =m s e r v e r . getPlaye 
r(' mu law' , ' default audio 
device' ) player, play (1) 



[0040] ^UXh'J-A7-Wft(i, HR 
izKmzW,m-?&T7V7--^3y&nW)L. Wfc, ^ 

i±U3-ycr>mikfaX'$>&g:-£ (Confederat 
ion)^'x?ht*l.. 7U- J V!$.\,M±UZl-y 

it. WBMzm&zrnnzti* jam*, mffrbimti 

TYPE C o n f e d e r a t i o n=C LASS 
SUPERCLASSES Player. Reco 
r d e r END 
METHODS 

registerPlayer (player:Pla 
yer), unregisterPlayer(pla 
yer : P I ayer) , registerRecor 
der(recorder:Recorder), un 
registerRecorder (recorde 
nRecorder), . . . END 
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[004 1] yU-^-tUO-y^y^^Xb Us [0042] m^ir^^X, " ProjectMeet 

^-^VXcoW^i: LXffi6M^ (behavior ZtlfcO- Vl±. £XT<?>± dKSrS. 

s) *nsfrrs#iDW^r*st-9-#-b-rs. 

. . . session = master. getSessionByName ( 

' Pro j ectMeet i ng#3 ' ) 
. . . broker=master. getBroker () 
. . . conf=master. getConf ederat i on (' xy 

z' ) 

. . timestreams = session. getAl 1 Streams 
() for each timestream in timestream 
s do 

begin 

. . . mserver=broker. getMediaServer (t 
imestream. mediaType () ) 

. . . player=mserver. getPlayer (tiniest 
ream, format (), ' hostl' ) 

. . . conf. registerPlayer (player) 

end 

conf. p 1 ay () , . . 



[0 04 3] jg£{C{±' xyz" VV3 6*1. 
hZblzWS&^X'hh. fB2Wn^5A{±. 

*mmi-&&x'Z&. zix.it. mt**h<r)±.x'^<^ 

frcoyv77J*£9m-t&Zb£-*S1fcb-t&1)K 

T't#. *il6£' xyz' «figfc^(^ffli-r&-i:* i T' 

*§mi.. mwthtzishcDmmyw? 

-6. 

[0044] Kv hii^rcfts . ~r 

n^Ali, ' noticeEvent' tCtqHfftS^ 
aitta^yy x ? ht'J)S E v e n t N o t i f i 
e rZmmthZb&X'ih* y-f4 7WTkL -b-y 

X\ K>h^«t'v ^tftf-wmi^iflEfc:. 

LiveBoard^^yh'^m^. 

l> i t A J T'# „ Sii^fl/cE ventnotifier 
Srffii.*:^ A7>f W >?-7±-xizmm-&Z b 



A<T*i ("f =Sr*)fe, =J— /V3*t/£ noticeEven 

[0045] i§iS8^li<±, «**>»&jftT. ifc. « 

h 1) -A£ +^-(cS?'J UfcttJBfc < t V ^ 

1/3 0^T (Mi-if. =flf:fcfcU>SH»fc> 

C - 1 7 6 9 X'&^btltl* y h 7-^l^7D h 3- 
)V (NTP ) ** s ? a y ? * 5 U tM2W£flNt fc«H#1- 

corn k- o . mz*mnwmimmmzit%> 

Zb\ l z£->XXtt%:< . Viv-yiOKll^KCt'O^Cji 
<nm$.?4 Ax^>r§n$*« ( \zT*X'i*VT>i>?4 

ATo h 3 —)W COT ) . T- 9 i?RM 
%?u-y? V— hX^-yy°^f\.i> b\*5 i/X7-J±<r)m 

m&t>mmz-H*x$>&. 

[0046] fli!C0«^tC{i» m<F>X7lT?4 



(9) 



mm¥9-l 7 1448 



AX h U -AW y=f -v 7 X 

JSffl^ixi.,, 5:c7)y-h^o^T(i. ziili. 

imztLtzttm^m&mzx'i y?x'*>2>*ot,z, s- 

AX h U -AC^f yf' y ?x fcttJtSrtttUf&^&^C: 

*TH4^-|f>xTOJiC NTP5r^<i> -ttTV^ix 

3. W7y 3 Mi NTPSi 
v^y*^^<7)^Srf#§^tf>^. i$|Sh?--A£:3- 

«±. ^S'JS- "HMH^fh" coJE«teffl-$- L*X 

[0047] mmzti&fflMniEmzcommizffib'sm 

ZkX'h*. gBOfl«^?o-y?£«iKWt^m-ti- 
•S £*'><93M$#JStt£fx.g> t -tlxli. > \ > F'VP Vay 
K'j.-^^v^iffifflmAa-rJi. &liTXir&Zttf 

iXV-vfT-vyZti. Z^uvTlzX-oXfJ AX 
>M±. ^-f^ua-^oy^KiO^^AX 

[0 04 8] K'j7h <##(CffiV^«f&X7-) 

imth^ v^sy^. nmzwmxibs>. sutut: 

? n y ? tfUm £ ix*r-fe vya >•{;:£ v ^X<#mk $ *x£ 
jBf$<0^Ktfc#LT. ^XT-AW^jfiJ#ggf>{i«* 

\3-y?£Wk<r>&V1-jL-y?~t&tzMZ. -fe -y is b V0M 

mam (mi/. a^^SS4£*iFyrSlt0i:l=ii. 8 0 
5 7/8 0 0 0-CS±) ) fcWc-f-^SriR 



&s#8 o o o^yyjv/^xm^Lx^h t ztitt 
-f^gi) <7)ztit>cr>mmz)3{?&vvyhi,3.. m 

[0049] v-y?- (-m»^mmsi^y-) - 

SCy-Xf AcojiflJ&iiW-Cvs'-y 7 r-f & i t lz£^X 
[00 50] ;MAXM>-Aft£-fe-yv- 3 V (^r-V7° 

«" Ux$:^> tCfelt-i»|H|»J^®«, V/W 

[005 1 ] ^tM^r-fe -y b #a<7)^ -? ^ 7* 
^-f AXhU-A (tJ--^^^, t'r*. tf*a^) 

izmm ix z ixhcr> 9 4 ax h v -a^m^v mmm 

iZ, -£XnmW$z4:*T-?$:ffiZ-XiSK). ffiaE-f^ 

[0052] ««fjft-c<o»aFa:saiaMwc*jv»T«. « 

* * & fcft fc: . -Hi-t HM LfcM F U 7 h yXfA ^ o 
>y^2:«fflLT. 7 y-*-f-/P=E-K CI 
nti, #^<?)7W- J r*5. v-Xt'AB^PbI^®^^^ 
ffif, ^-O^-f AXhU-A$:||^-n,Ktt*^-S,C:t 
2rSi*-rs„ ^c0S4Xf-K{3fcUT(S. iixiiS 

* (.Rtf. ^X^ABf^ia) ^1#*<. jT'J^/Ut-' 

* *?um<n&«<mmz^mzmL~$<<.%x]bhzh 

'o<7>iSV>ay r ffiV^xe-FS^OfttftV^3l(i:. jl- 
-f<7>£gt,z)& tt * x ^ v>f X-T S i t *-"-C^ & £ i: 

li, ji^'5r^RI*^3i^S47>c01^b'r^^ 'J -y 

?mizmmv>t'?*n>ii£&i>£<mz.&fri>L 
[00 5 3] yv-*4-j\smmt:tfiozt<v—mm 

®t±. ffi-f£Kfif-f|>k<7>£>'K -?-iT.(ift»^IB5&i:^ 

(i. £xtfMm3mtr* h ru— Yizmzmf-r h z t 
tmzgim&^T&zcibzmm-z wx.&. y 

~>XxA^^T«$^^c7) l 0 0%c7)ji^iSJgT' 
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it. <MzWi<VT)V94J±9uv9Wft (Adhe re 

nee) wmw<7)mttz±x-iii-fM%iLtzmitiiZ&m-t 
s, w±.cdw&u. mz. m%.<o3.-?mM s 7u-* 
iz^-mmmiE mm. ^xf-Thz^-myis 

[0 0 54] ^WN-H^iTr-^f^ft^ 
n y ?Btt, Bl£#Sgl/tSMJ3#i*. miZ&ffit 
&b. -fe-yxg^S&iftt^ju— ;H 0 Hi, -kvisay 

*eiH-4*MteLT«**> "Aw^-tyr ton. 

S-tPSro. ^-yy^ytm^J^-Mt. tmizii. « 

•fe -x a >-#w^a 103 ^^j^-ri. i k e$ 
Wf- * £^frr & Tt^^+^-^ijffl-r & c t tfix- # s 

it. tm^Kt^-v^3><7>^, m/. &mzn&* 

Bit^ixS. ^^^yS/ai^ttlfrfcS**— /Ul 0 1 
it. #«^+7f +gil 0 2 a - c CioT "IB 
8" ORttftm(cP9BS««. #*<7)3-^T^iga 

[0 0 5 5] 0 2a-c(i s 

fc*Ht!M / 0'bt4(W4. #*r?**JSBl 0 2 
a»i. rJ^ Uh»J-Ai>f^bf-^l 0 7£56£ 

f"*««10 2a«)WHL *Vy*JU-TM. 
(WfD7?X*ynz-(Xerox Compan 
y) (7)Li veWorks (l$gD *^A#TO5rTtiIK 
OSfiL i v e B o a r d (WR) O^^V-f 
hsK-HT**. fflS^ffl^'^-r^tc^o-C, L i v 
e Bo a r dfre>m%£tltz? 4 >J-Af-^ 
Ji. ^fifflB«fc:»*-t&. ^yht, Bf^^tne (« 

i.tf . L i v e B o a r d CD±T^— ^O^S ) COWlf 

[0 0 5 6] ^-vT^r^ai 0 2 Mi. ^-f^h'J 
-Al 0 8£?S£;*-£6. *Oid&3>c7>=Sf^T?^§| 

{-oj:a^r7*f-raaii o -ihow\<r>m 

it. *W>:?T'£>.g.. ^y^^^7°f--v^a(i, sjf>f 



[00 57] ^Tf-^B 102cli, >f ^> M 0 
9 £#(;:f§£§-££ . **7-*-*8»l 0 2 ciOGWi. 

^yh<7>±&&. ^yt«fw-ia- ^nass^ta 

[00 58] =*-r7°^Siai 0 2a-bt±. 

zmn txwm-hz 1 a. *%m<?>wffl\*ix'$> 
£>„ 9-iJ*.xvv-^<r>y*--?v bit. ?aj±xyv 

-j*t£i&^&K#>izmmi$tiz>*<ry°^mw.izttm 

^.fiSS*^ — ^T. Li v e B o a r d?^ AXbtl-A 

<7)PSffl(ciKBB?as ) <mm? 'r J )VX'1b& . SIffSix 
fc^AXh'J - Af- ^^fati . t'co i d =5r*&T 

Z1\h<r>T—?ZWm-htz#>izM!lRth zki?X*% h 
[0059] &&2tlti-m&)7 ! —?it. -fe •/ 3 

S^ai0 3t^«^s. t.yi/ 3 y^no3 
{i, -f-^oa^ro^M. -T^*). -fe -y a y-r- 
9. Kyb?—?. RTf. 94 &XhV-J±7-'—7iZ 
r>\ \XfrXWZWm8L*W£th . -fr-y^a 
ai 0 3<i. msic(i. »5ro!tWlW=fl«B»6afc:* 

[006 0] |sl«^. ^-vissyWmmi 0 3CM 
$itT^S<?5(i. -ffiJWx-^r^^^if 1 0 4T'£> 
•2.. -^Wf-^7t7>ff 104li, -fOM 1 0 
-»$«f-^ 1 1 1 HtHfrthtzib 

izm>ix&$m^®. muz. 3>fa-^ci^* 

WfA) T$>S. ^^ybffi^i. -fe-y^HV-gW^ 
81 0 3t=R«fc:»BIS*l6. 

[00 6 1 3 teii$tL^-fe y^3 V-^.<7>r^-feX{i. -fe 
•yyayr^W-^^f-i/ayiO 5tC«tO^ 
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■y ^ a ^ftlte i^* A-/W)li«ttli s HiSWtCli-fc <y ^ 

3 >r?-i:x7-^xf- v 3 y l o 5 tJ: -^TtT^*) 

*t£. •b7i'3V7?-bX7-?Xf-y3yi0 5 

AT'* O , -fe -y 3 ymt:Wi-6$'JfflHi. 

x-f XT^W±{c^$^y57 y y"Jt-— 9*W y^ 
-^x-XCiOitfiSiSixS,. W9^77<7? 

a.— tfOSUN Microsystems I n c . 

"Tt^X-Wi ndows/77< -y^i-lM 
V9— y*-X£ffilfcSu n OS 4. 1 Pf^P- 
•7^ y/yXfA^UffJilSSUN SparcSt 
a t i o n - 1 OT&S,, 

[0 0 6 2] t7yHyr;«7-^^f-y 

3 yio 5^3S^§nrv^^«±, ?v-*r \ 06 , if 

£ftJf3Pi£«l 0 7 . mf. if^lO 8T$>-i.„ 
•y 3 yr?«7-?Xf-ya y^-e^-g^ft 

fit, vf-*^ htii-v?42*xhv—j±<DU 

£.13. -y 3 V«f -f X7y^f JkoSI 

-?xf-y a yf)f ■< xri/'f ±^ 2^>) -f > H7 

tit. L^L^* 5 ^. 7U-tii-fe7y 3 y7?H:X7 

jee* mmAX'<7)ftm%mimmz*>^xi±. 
*-^7^K7*'. y°is— v. mkMmm. mt. 

if A WWm: 'ttoZt & . S^t'cO»a 

a. 

[0063] &.mz. if^ ?<r>®.mz x v&mztitz 

*rU>-WWf-* 1 1 2(±. -feyva y#«Stg 1 0 
[0064] ftlSIftHtlCiottS LiveBoard(0± 

f^ffl-r & i k tfTZ a "ftirsigr £i§«i-& £ fc ?"* 

S 0 L i v e B o a r d Wl/-f -f > y/V 7 
n^xTM fOj:^ W-«Li ve 

Boar d^y^C&Sjtfgtf&^J; 3£t&|f-$*x3 

mm:mSTffhitt XdlZ. ^f&CDL i v e B o a r 

d s y h v-t&fiiT-mzmi-f&z t 



[0065] w%&x°ni$m%mmmizt>^xmi>ti 

tz£ O&L iveBoardll -visa yfEifK 

>fyf'^X 1, tzfrcr&ftX'h h i. o (C<iS0 

ft.£<k3C LiveBoardll -cftSrsBMSfUt 

■fe -y ^ 3 >-<7>di<7)W*iiZfflffl-?& tz#i<vm&rj:v-Mz 

-t*a»W|fcft*ir*-4. LiveBoardll Ti 
vo I irr'Jy--^3yc7)ftlJffll^TT'tM^-rS. Ti 
v o 1 i T7V jT— is 3 yJi. Pedersen, 
E. , K. McCal K T. Mo ran. &t>\ F. 
HalasztiS " "Tivol i : An Elec 
t r o n i c Wh iteboard for Inf 
ormal Workgroup Meeting 
s", Proceedings of the 1 NT 
ERCH I ' 93 Conferenceon Hum 
an Factors in Computing S 
ystems, pp. 391-389, Apri 1 1 
9 9 3tci¥WclKBH^ixTV^. 
[00 66] Ti vo 1 Hi. "ffiM" 7*n/7Afca 
btlX V iS Bf&fefifcT" 0^7 Aco ? 7 x t,z<PXX V 

Lft^TS. Ti vo 1 iHfflti. ^77^ -v?*-7=J 
j.7 hb LXffifrtlh , ?57 4 •y^Jfy'^'x^KS. 

/Hy^" ^-y^'x^. 

: H^iT^m^ttl.^. h7r 

-Hfc/T-f 3Wyin : ft*>ii^fL^V^±3 

it. 

-?n«y? : ^O y^>-'xXf-^-k*^ng$itS. 

mt LXmtlh L i v e B o a r dcOJif ZitfLZtl&ft 
W^-fX'Ibh. 

[0 0 67] Ti vo i nt, mx^titzy^^^y 
^s^wjgsuxhSr^-rs. mux, x-fv^v 

Z&m-Z. ^y^'x^h SrS^S. ^-y'^x^hSrS 
7 Y kmmm?$>1x& . JilTCPSfflC^^ix.l. J; d 
[0 0 68] LiveBoardCStiJy'77^7? 
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vim mm. 7o 7 e-fa?) nrhv-vzti 

9 -fe y is a yrfJERcvy'ls-ey^—i' a VX'fo 

[0069] LiveBoar d<DM ftCDWcoMmftm 

ttffftCOffiSO M V9*.Y U—9 (inkstrok 
e) " a^dfc&Jft&fl&tf. (fflx.i£»ft3 
VVH) i;tT(B$?$*U>L i veBoardWII 

9i±. *>fcH>L i v e B o a r diZtefflV&^LfrLZi: 
f^T-^^ix&idtc. *&!!lfc:ttvvcu. -fey 
^3y#B£3ftl>i:^ "rf-^h" BflbWS**^- 
**J>& ) . 

[0070] ±.i£Ltz£ ot,Z^-y^a ^WSmWte. 

* >f AX h y -AT-*t? 
Xh'J-A T-^f t ? *-r OUS- o ^fgfiKWIRtc <£ ->T 

tf. W^^fAXbiJ-All^l (?-fAXhy- 

[00 7 1] Kfi,994 AX>U-ASSSIS«. 
AX h 'J -A(7)Hf^c757--^*^S$^'gJl$ix& £ 

{fo3t^-^-yx*^^S. ^--TAXh U-AT-^f 
t' <9 <k d &:«£T';Mu *-ix £>*>'S£>>iWC& & t M.fflt 

im^mmmm^n^xii, ±m-^ t < ruw< 

(4. *ft£cOT-?£jIS<OUn i x7r^f;W:l«t 

VCR) OfcJftO^f^T^W^fcHfcfcSSttSitfc. 

itf. 7 -/TV •yy°3yt'^-?iZji-?Xft*)liiZtlfz 
JtCOS-h) Zffiz.tz94 AXhy-AO^COStffi 
SW=5r»«i-f-&^t*<T"#S. **)*>[ AX by -A 
T-^^tfxO:?-* AX h y -At— :*"<.-x£te3 £ 



[0 07 2] t.yy 

3 yfc**n:u -t -y >- a >c?>mm£izm-z>7-? , 

y -At- ?<-X<4 , i-if A>\ BfScO-b >y v a v£ 

-f AX h 'J -A(cii#(t £>*tT -f ^> h iK^ftii 
-?c\tzy-*-hi-&. 94 ax h y-Ax-^^-x 

14, ■fe yv-3>-r-^<7)ra^$-1?-*'-N-ri»^f(tT'5r 

fg^Sr^-rST-^-XTfeS^^fftS. -feyya 

(■mtfSr^-f, Lfc^oT. ^»l«4ga (iMMi-r ■* 
Xi?) fc:*«sn«r»tjfitf!Sr^«rv^ AXh'J-A 

r— ^T-^-f ^tistr^x^ vfe$\x*hh<r>x\ 

x. 9 hJU^<7)f-9^-^i)K 9 -4 AX h y -At-? 
<-X^ci6c7)^8g143{p'$>|,5ry^x? bS«^ai: L 

AXh y-AT-?^-X{± % Unix7T'f;^ 

XTA±TlUI$ixi»o 

[0073] -HSW-y-^Wi* rtffi-T^^ AX 

LT#£«9i><7)T'$>S. ^-T^^ffifg^^'f AXh 

y - A<7)^^t ti , >f ^. ^ h co— ^oy%&&mm± s # 

1 ) #5:-9fcA#VvpKLTiv6a»£«^*fc:MA 
Xh'J-A$-t^y h-ftL. 2)MLTV^Al=«^ 
cO-b^y hSrS'iy^T'C. ^f— f-t^h y-A2r^- 

htt. Axhy-A^ttS'f'O'bJr^l-r&c: 

fctc&S. 3r-TV^"Xhy-A±T'^(OJ:3^*fSr 

IStlTV^ "Unsupervised Speak 
er Clustering For Automat 
ic Speaker Indexing Of Re 
corded Audio Data" bM^tltz, PI 
BSI8*I*oaiS#^0 8/2 2 6. 525-^. mf. 
"SegmentationOf Audio Dat 
a For Indexing Of Convers 
atinal Speech For Real— Ti 
me Or Postprocessing Appl 
i c at i on s" tS$it?taili#^8/2 26. 5 
1 9mzmW2tlX\^h. \^tlcr>Or&X'i> . 
Znkotcftmmtcbtl&k. *-?4*cr>94<LX 

M,^9yy. mm. x.ts. mmm^mtsmm^T- 
9mm*t>f&&z\tiz%z. 

[0 074] LiveBoardlCt^tffilSh^ 
>fAXhy-A£0^W«0*i^(4. JOhii. fflffico 
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mam*. 8ffi<?>^-*>7'fcnLz%i$tLfizmi. $ 

Uli. ^<7)37>"Kc7)L i veBoarda-tMy 

3 t„ LiveBoar d{4. T i v o 1 i TTV 
-> a y<0©J1W(?)T-Ci!l#-ri. . T i v o 1 i iz X o X 26 
SiZ^hlxWi AXb'J-Ali -f^W^Jli^T'fSII 

[0075] Li veBoar d±<7>g-*<?r7— 3-^;/ 

*%mzt->x. bmrntx^z 

•y t LT jl— nHSftSftS £ i:**!#g-C'£>S . -fe 

*u mmzti&zttf. <mx't>&, m-ix. *%wiz 
i Jx.? hwmj'<->h£mmz^rtz>zttfx'*&. l 

iveBoard^-^AXN 'J-AOI^SgllJ. L 
iveBoard")^ F^fcWLTJilTfclSl^ft 

[0076] a^-eoies^iisfijBaHcisv^Tn. -t 
(man* thwa'x, 

^ty-203 (t*£M*>J-2 0 3<4. ftMWfcfi. 
^ yy at ? -fe^. ^ t u 'j - > V —x ^ 

U -<0ffl^-^^T'S>S i fc CWCST* & ) 
AX2 0 li&imt«Sfl*-'f y^h^^^H^Srllfi 1 
■T^/i^corn-t 7t-20 2 S-jgtc^TV^. 

o^A-fyxh^^i'gyil figM^'J-2 0 3£ 
^SSil*. 7-CJ-fe-y9--2 0 2t|*lg|5^^'J-2 0 3 
14. flMafllARX. j£v>t4. ffl*tt£*1ftlllK (as 
ic)f yTeoi p =5rm-c7)m«Jiat -Tl. i btfTZ 



7o-fe7t-2 0 2fcl*jgM ; ED-20 3(4. 
[0077] Wmz, *X 201^ JBBPf 

r< 2 o 4 . -T-? ZWfcth tzvxntm 

Sfft£IS2 0 5. ^-y;U*JMW-4fc4r>0*-V;MM 

9P^«2 o 6 . mf. mm\&ttmrti-htz#><r)T 4 

XTW2 0 7#>S*li£*l.S o *-tf-K2 0 4(4. A 
fflWWit^cOQWERTYdf- |s]«S 
(C W&m<7)£?%*-rtvViZ-t&Zbi>X'%&. *h 
S5g«i£g 2 0 5 i4. ®^£0^^ >J± 'J A-A^Wlg 
iS^<43re^x?^Sk^&£fc#T'#&. #-7/P 

mmm.2 0 6<4. jymi^t. «s&{a«&D*fir£To 
Jvmrt*. ik> ^20 1^ *-T4*ftjj 

5f-7 r -f>fai^#S2 0 8«±. TV— VfcLTt 
ttf^-l. - i: 7^T'# •& . Sf*tC. 2 0 1 

b'x^tii^*S2 0 9T'*)§. b'x^tli^#S 

^x°%h£^\z^&tzfr<mw.<r>wm-m. mut. t 

[0 0 78] ■b'?yayr?«7-^Xf-y3y 

— i v e Bo a r dCOX d'SrftS^ny 

[00 79] -k'yya >T^-feX'7— 3 y 
zs3>£&-iXmfct&. 03<±. -fe-y^ 3 >-r^-bX 
ysyT^-feXV-^Xr-ysylt -fe-y^ 3 y$rW 

±-rs«cffl*^^i$nst§. is&«.i3oi 

<JC^T. •fe.y^ 3 yii i t!)«ffi3 0 2^A-5.„ b 
>y^3>-teKl^®3 0 2<?M, mkZtlh^-^-vi'* 
ytfa.-*nz£^XMtR2ix&. MRZixtz* v ^ a > 

(4. t7y3y7?tX7-Wf-y3yi: Lt|S|t 
Ufc iSKk f h Z b l> X* *> z. t lz&&t^ X 

?tX7-?Xf-y 3 ytCjSSSSix^'r iz 
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mx-i> wvia+z t&x-Zht^i mm^mx.^tzMz 

mt>tlh« V^tfl^Tt. ttftJC "f^ft" tt!S3 0 

303izh&ffii. 3--*fxw,zmtxm*<ryrv 

\iW&<r>T<i 3 y<7)±T'^ 'J «y ?f & £ i: ) WJlJ t 
(±, -fe-y>-3y<7)^$r5l^^£^-£t{C^.|. (*>y? 
^304). .rftKi 0 , "mi" IZ* y h 

^K^KE^S (*y?X306) . ^ia^g 
•y ? * ^ I. £ i: #T"£ S . WrfcflJfflWt/a} Ui . W 

<k.<a&&n$M& (^-y^x3 07) . ztii±. mu^ 

&X'**.-Z5-tX*vi/ay<r>miZ3\*feZ-$- < , fB 
IE. i&v^ »Lvv-i^7*-*«o^<mv$*hj&»*§| 

*>Btt&(£ J: 0 . «R®i3 0 3^<o!M»3W^t 4 . 
[0 0 80] *<9J:d^$tc7)iMm. tyy 3 W 

flRfcf. LiveBoard^O K^C7)3f y^'x 9 h 

[0081] gf^, mmm s o 3 (=&&isl "a 

Zit&ZblzKZ (flcjbttfll3 0 9) . 

[0082] H4{i, t^ayrn^v-^xf- 

fc, fflmizmnkZtlX^&nte^ LiveBoard^ 

y>fy^-7x-^^yH , >403. y— h^y-h' 
Wf-(ri*>>^ yK->4 0 7. s-x-ry 

/ri/- ^^>K»>408'CS)S. LiveBoar 



LT-fe >y 3 >*5?l£fc*f^4«!lf|&»rttfc-*-4 (OT 

n*-c«***i«-fe -y ^ 3 >-tw-ri»^<7)as?^^s 

[0083] h'-r'sj-^ -f y h'^4 0 2{i. h'f^?^ 
4. /-h^M>'K'74 0 4fc4 0 5kL S— f-f^ 

& y - h £ S4rr h tiMzmm zn& ru-rr* & . 

[0084] S— r--f yy-TU— yF»7408 
— \*><VF*4 0 8tt, a^^rfBs^-^Wx-^co-f 
^O^-t5>y^y.c0>'5 J t.P— ^3>-^«-ri.. S 

s-f -f y/riz-w ^ y K>) 4 0 scms 
s^cor-r ?>t<7)ttjiftmiz£<ommzti&. s-^ 

4. 

[0 0 85] 3f— - f-f >-H^4 0 6<±, ^"-r-f 

^■cD^-f AXhU— A«0S4i, ^tC-tr-y^3 ycojj-— 7* 

[0086]7^f-(7If^407ll ^-fA 
Xb'J-AtUt'yyg yK^A UT^-T «I i: ^T'^ 

7-*-f^4 0 7«i. ifc<fx^7X3 yr^-fexv- ^y. 
-r- >-3 L^rv^/l/^yr-f 7^#Sr^-T 

hfcMzmoZ\k1fiX'%&. 

[0087] ^A^W y^-7i-X^^ >-H-7 

403(1, s*»j^aT-^>4„ ^>fA7^y^y^- 
yx-x«7-fyh'^4 0 3ia. ^.yh<r>— vm%i><?> 

Ci-^V^ha-^. ^<b^-t-y^3>-«^514.-t 
S^^T^WStc^ffi-TI.. ^-fA7^y^fy?-7 
i-^-fy^4 0 3ll, WTfci^^^^ixl.. 
[0088] *%BBW3l^-C»ii^llSfi®«<?)^ 4 A 

^'fy^fy^i-xii ^u^-fyttSfc^'v 

10. ^yhf-?li-fe7>'3y7;-feX7-^Xf- 

y 3 y^n-«ti5. ^<yhT-^«a. ^-^a 
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B££b y is a V<D»J^SBOTfclftS®»3-* 
[0 0 89] o-Kttfifc^vhT-^U:* 3--1f£ 

mi. h t y P e s twsti&mmm&v&ffizn-t 

Spe ake r/Adam 

LiveBoar d/E d i t /M o v e 

Bu t t o n/B e t t y 

Note/Laptop/Char 1 ie 

a— yaWgfcLfcfi-^Tli, o &H t y P e s 

Ycr»U*—?im%L, Htype^f^OHi-r^-^ 
tfHr-y <X^X\ HtypestOt-yMi, «f 

0h77 ?x "J TO^/l^x U TrtTJL— f ic#f LT^ 

Z>Zti?X'%&. HT^Mi. h77?V'yrt:J:!) 

9±lzmiZtl& HtypescO'JXh Sr^rO^cO h 

[0090] t'yj.7;W yyy- £-*?c0H t y 
pes fcolvC4.j£S*i.S. b'vjiT/M 

v^Tti. AAV- h £3X9(5 t#>S 

ztZm-tJ^yh) wmmtz'^^xnmiAt*^. m 

- bV a7My S>*- * £ & J*-*-. 
-m&itzY^-y ?^t'y J .7;^-f 



UW*-JI#<*>fll«*J!.*. 

m-th. 

[oo9i]05(i. ^-fA^^fv^-jyF^^ 

WFIh5>y^xU75 0 2li. b-/^ 3 >-<0 
& fcfttcflfcbiu MjfiKHa h7v?x'J7 
5 0 3Ji, £ft<7)b>y ygyiO^I.^ 

XZ&Zbli&M&^X'&Z. SSV^i, ffilBAOTf 
^7y3y^7y 3 yi0 
<F>7.>r-)VX'hh . 
[0092]«ih77^XiJ7502rt(:M?nfc 

0 3F*j|(;^$n^{i^O y^X';T5 1 
*fj£rr&B#f3 h 5 v ?X>J rco^x^-^fc A -7" — )Vi: 
Tjk-f-tztblz, &«<7)7u y7x.VT5 1 2t 5 1 3Ji, 
^o y^B^Stepv-^SrS-t. «Hi^Sh7-yy*x'J 
T502J2. *<WC. ^5h5-y^5 08i:^SfL^ 
hv-y? 5r5£#S U-:.MN77^5 0 8<9_tK 
$>&(OI,i. M^ib^>-h5 0 9T'J!>S„ Jft^b^y 
b509te. ^*H#iah7-yx'X«JT5 0 3(ip^$n 

st7y3y«^n. sg^, -en^^h^ 

-y^X'JT^R|ji-r&<0(±. 7^X'J7tfe4, 

"h77?" *m\\tZ>tcthlz<r)i><nx$>&. 3 
^l-x ij T 5 0 4 iiiHSBf la N7'V?xiJ7502C» 
JSEU 7^xiJ75 0 5Ji^»fSh7>y7xUr5 
0 3^lE-r&. BfflltB$li1 t^-y?X>JT 5 02fcM 
^b^-yy'XUTS 0 3<7)^li^{i. MXIJ75 
0 7T-*$il&. <r<DB3£&ki. l*-fe^yh5 09« 

* { S7-A 5 1 0 fc 5 1 1 CJ; 0 . WfifcB*CSi& J: 

[0093] |S)«t . 0 5 XWm LtzMiX* yi 'J T 
5 0 6-C&S. #^^xUT5 0 6(i. «^cOS^JfflI 
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[0094] ^>5 2 0li, B££l 0fX^f7 7L 

rmmtztzMzmmzti. #^52114, w££i 

4feSr^ih-tS^^ffl«$il-S». 5 2 4 (4. -fe>y 

(4. Hm^-h'tcAoT, ^^7^>fy?-7i- 

(4. ^MtcJiEtTtB'J^v^irJt- (09i.ti\ tV^r 

Sft-I.. ^y^-75 2 8(l XRfcJ5tfcSK5ftS 
WdW <<yU<4\ h9»^«)*7hW-®b9 

9i±. ^ vis^yt-^-zmTF&htzMzmjbtih. 

fe >y a X*— *— 14, -tv^-g >-<7)7ta6lC 

f-^^o-KL. ^7x3 7L, &V>(4. -fe 

•y ^ 3 y*±#>h i £ "TlBlc** . 
[0095] ±£3*ufeJ:5fc:, ^B^h^-y^T^ 
XTWxyrfc^fi&fe'yv-ay^-g^ IKffiB* 
IB h 9 -y n'J r^M h 9 >y ^<0±lc^iil&^-b: 
cJOO-HctO^SftS. ^^EIh5 y^J:'JT^iJ 

~¥iZ£*)-*MXW1giEZix&. liili, 06 -7 TIB 
W2ixZ>. 06{z*nvC. MW>h6 0 1(4. 
j& h ^ >y ?x 'J T 6 0 2 fc^StlS-fc -y i/ 3 >C0— 

fl-Wltf)? Dy^xUT603t604 £*t-f S^-ffc. 

-r^*^. «fah^-y^xyrc-3v^Tc7)Epv-^fc-e 

y ! J*r—9 6 0 5 i: 6 0 6cDffl#eS2JW>?;-£tj. Pl« 

ra-f y'j-y-—? 6 0 . 

[0096] MA-*?* V h <D-»M XHHE(4. 
lz{mLX^hmz-?*7Xcr>T$?>tf1ftiiK&t. 

yy-ii*- v )v<mm<mimz^\ %m& $ns . 

[0097]I7il, j^jSfl§jb5y?xyTl::^£*l. 

^ >- h 7 0 1 <7*»7)*£3iCD0T;&S . ^<50tflP Lfc 
.X/'O'li, ?D7?XiJ7702t703 ^-ffcC =t *) 

yvfmJTlzl^XcomTmfflcogtft) . 
[0098] $M A7-f W y^-7x-^li, $-me> 



*visa><m$it:W®tht&>^ i£^(4. #-<0fe 
•y is 3 yn&Wnx^yizgj&z&b-t&tzMz&m-t 
&ZkifiX'%-h. 08(4. rsow-t-yisaycofiztbco? 
■< J±y 4 y 4 yf-7 n—X<7)mX'$>& . ZOOt'yy 
3 y(4. -B+tf>S-7M y?cr)¥m*ftk*rt£¥ftt: 

iliWCt4> "o^fe-y^a ytelSS^iIttfcWf 
*. 08£#M-fl>i:. 94 J±v 4 W y?-7±-A 
-^as^rah 7 y ?xy T8 

0 2fc803fc. ttJE-t&m^H#fSJh5-y?xyT80 
4fc805*>£>j£6. £u5-fe? f ;><»8 0 6(4. «HK^ 
0h77^X'J78O2 K*fj£-f -y a 
Xy\°y i: . ^C^S h77?xiJ7804 Kisitl. -e<50 

8 0 7(1 «HR^h9y^XUT8 0 3t^JCf 

>y^ayiciJ«tl.xyN-yi:, ^(SfSh^v ?xijts 
0 5(,zt5l-r&Z<OX->*ylZ'3^X<7)mM : £7F;-t. 9mcr> 
V 7 •</ i7<i , -efL-fii^lRjB^ra h 5 <y »J T 8 0 4 
i:8 0 5T'iS|— -C'^S^SJS^V^t^^-r. t>L-Hx 

So TjxyismvTX'ftmz&Knx^-xzmi 

^-h<7)X\ Ztumt t<^rv\ 
[00 99] 09(2. co-fey a V^IBtOXKy 

^ y b S-«f»B#S h.57?X'J T h 5 y ^ <0±(C 

09Sr#Bg-rst. micomM.^^yh 

9 0 111 $L<mf® h 7 y 9X-V TftCDttm-t&x. 'J T 

9 0 3iz^titzmm^-r?>-^. m2cof&&*:y* 

y h 9 0 2 (4, 3^^^ h77?x'J TftcOfcftS-r&x 
Ur9 04$-#-ra. ^OJ:d^7-'^X7V-<<±. m 

•ts»*#2:v^B£x y Ttf&fcth zt&m-^x^z 

ttlZiimt («ilf, LiveBoardiO« 

^b7'y^x'J7"(i» |SItX^-;l/<?)±-C'i:-003li^-fe 

^h^7?f^X7W CO-SP SrlJiE-r S £ t *<T'# 
So i^-Cii. H9<^xyT9 0 4(i. 01OOXUT 
100 l^ltSD^ix. a9<7Dxy T9 0 3(il31 0<0X 
y ri 0 0 2^^-S-B-^iX^o ^X^icoiijDti. 

xij79o Attmz-fiE.iz&m-tz Y7v?mmzi. o 
to i oo] 01 1 -hi 4(±. aT^^y^^m 

Liveboard, x ^1/3- 
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y, fr^SyxfAtonT^^A^'f yjyf— 

Xf^TM t=5ri>o icOWcoVvCO-te-yi's 
Jlfttt. T^a. "CtM. **-'J-fc«tfW4> 
ft5. 

[0 1 0 1 ] HI 1 ffIil$Pi3h5-y ?x 

'JTOl 1 0 Hi. ^co-fe^i/gylc-PViTcoWfSSr 

. -y is a y&^-tM£.-t /^yh 

•5. dOiotcLt. i6Wfr B ^7 7^xijri 102 

—9 1 1 1 3 t 1 1 1 4(4. ^^^-eiX-Fit^ratfO 

[0102] mz. ■fe'yyayiuri i o i tm&w 

£>&0#. ^-visaym^l 1 0 3f -fe'/ya 
[0 10 3] II-fe7i/ay^Sh7 7^l'JTtSa 

(4. t'yxayllMl 1 OAt-kv-ssymTtm 
1 1 0 5£-£tf. -fc-y^gy-Mi&^l 1 0 4 fc-fe-yi^ 
a^ttTBSIBl 1 0 5<?)#*fi. HE'yy-a^jWBSfcB 

<7)IH^^HSr^-rCt^T'#. !&U4. 0 : 0 : OiZ 

*t+i>iB*mme*>h mi lxmnt^xdiz) . 

[0 104] ^MWih^'y^^VT 1 1 0 2kR|jtL 
T^&fl!$B(4. xy'CyBttWriai 10 6 fcx/tyfeT* 
^11 0 7 X/^lWSl 1 3 4tX^yJ? 

TB#R31 1 3 5<D£-*(4. ^O^N-ycoB^SHScDKSp 
SUCt***. -fe-y^3>-Mte^0(C^ttl>i, 

[0 1 O5]M"l0N5-y?xijri 1 0 2(4. #h 

5 -y ? a*f?fc*-r*H»x» $g^ffi«-rs ^7-^5 

OHrx^a^ 1 111 £^tf„ h77?1117tl 
1 1 8(4. LiveBoar d±t^r3:*>*UfcSWM < 
h5-y?1118(4. LiveBoard 

X'S> 0 . JSlTKBBUCjSC^feii* . h77?1117 
14. LiveBoar dlW^/y'i; hTlr^^itl 
*<7)mMmft£»-t<, h5>y? 1 1 1 7tCt3^T. 

yV^-ftt-tZ. *ZV* * 7 hnm 

[0106] h77?1119-1121ll *-T-f 

■xnA^yy^ffrt* h7 7 ? 1 1 1 9(4. "rr^" 

tfiSL-O^-fe^yhfc^U b77?1120fi 
1 2 1(4 "t^-D-" #fSLTl>&-fc;50< 



(4. W)^?x+\\,zi.*y) . 
[0107] h?-v? 1 1 22- 1 1 23(4. S-x-f 

ymmu^x-hhTy^ki-v-v-izj: *)mt>tit: 

XWyfeLX^h'^-Vi-tUayVj.-?^ *^(4. flfecO 

[01083 h77?l 124(4, "^y'Jfffi^ 
Kyhwj yxfyx&Tji-t. #*ct)$— f-^ y?^M 
^(4. «w«i&*M3&»*B=art><0*«Mi$*i.T fciSt 

mt^r j yzw&Ltiztzmv. 

[0 109] h77?l 12 5(4. ff^^^h'J 

=3r-f <y h (4 . A*^-T^a6(ci*>±^'S i t . &i > 
(4. *V-f htf-KfcMLT^M^coMcoJHBOSr-f 
6 ^c7)J:3^'f'<yh(4. b* 

[0 110] JhiSLfciofc. »ttl*5-y? 1118 
(4. LiveBoar d>7^ > H-7f*|cOSS?ffi5f^fflO 
^*fc aHRffiEftUflU, 
L i v e B o a r diC^JflSl^^yy'x^ h 

tfgffiMx. VTlzmLXtkt&frh Lft.*^ £ k (4 . i£ 

Cl^(4. #(C-7-^y^L iveBoardK 
«IS*lfc-fc y 3 >£0-a5c7)W^S!tJ6(C^fflT'^-S 
(#iU(i\ S^-ra-bXcora. ^^ yT**^fi?tL. jf 

SiJco^-yyx^hfiBJO^i.^ix^. ) . HI lCMo 

t/. Mc(4. b'ya7Myy7--^li. 4^yy<?> 
m^^tiMz^^-a-nt^tih. ZMA^yhl 
1 2 7(4. tf^x? h*«*«S^^c7)^$r^t. 
WC/M 1 2 8(4. ^-y^'x^N^L i veBo 
ar d±T'i6*^il7tr«FS0^5-^L. *7-^b-<^ 
>-hl 1 2 9(4. *9 Vi]>y-mzz_t>td-zZ)i 

£^L. MIM^M 1 3 014. Jf7 : Jx.7 htfim 

[0111] &«<n&fm\-7'y7^)T<r)nW>$.. 
■9**HRF5TlfC**. h^ y^(4. «r^L. ffflUU Ri 
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i?^3 ><D<PX-n %htih . , Ell £#B8i-S 
t. Tf *l-7y? 1 1 1 9- 1 1 2 1(4. SI#?$ 

«,9<r>mm±. mi2x-w^K. zzx-aw^ztifc 

1 2 0 l**4j£§*m^. h 5 -y ^cojMtR 
HSjlLTt^-f y?-£x4 'yf-fcflffiU *-V/^h7 

L*>U -rfUih^y^x-fX^TWilrfeSrlii 
A* $ tit: =» v y H t= «fc 0 of txai-rc t * J r ^ & . 

-h^ y^SriRE-TS (^(OHtypes) 

-SS?^h5 7?^ <— o*5b?.y?«0+M iff 1 ? 
Stf 

-miR^^h^ y^S- (f£OHtypes(C^W 
-MiRZtitz h?-y ?<5Dx -f X7U-4 

•tz 

[01 12] ^oth'^r/W V^*7--^^±^-K 

Zix&. y-h (Notes) <7)i§3-£<i. 

fN0«±«. 01 3TK0I3rt.*. HI 

t . tVaT^'f y ^7"-:? 13 0 1 y h £*u 

*-v>vm&m±.w( -y y ••/ ? . .rft 

^XN^-f yK^13 025r^t$-^S <££TH r- 
-r^fXN^-f yF^i. ^N^-y^x^xrp-fxiJ 
[0 113] *9>fyn SlSlRWi*¥armfc* 



[0114] ri/- **<o:7 a{±. -fe -y 3 y«— b$ 

y^Tl^— Vte. S*<DS--r-f y^^S-y^X*: 
a fcJU l> J; -3 fcfBIW § tzMz&bti* . miJMi 

rix— v<i % s-t-i- ymmizmL-f&tsMZi'S. * 

StM yK-7l4 0 0£lBBJJ-?-.&. 014 5r#Bgi-& 
S-f ^/li 5-x^yi/#*n*2:* 

ig-Ti. h'y A 7M * i?1r—9 1401-1403 

b'ya7/H yi^r— * 1404U40 5«iy— 

hx-^yc/^ia (Wi.<f 7 77 h -yTny t jl-^ ) 

Sr^KL, tV*7A"( > s J7—9 1406-1408 

h ^SBtS 7>f 3 y(iA>f 7 ^ b ?ix& . 
V>S<0-C. 7^nyi40 lj&VN'f 5^ h$ixl>. |hI« 

c tf*u6»j&*^ysif Lfcksc. M/c-rs^yr 

[0 1 1 5] f£*cor^3yco+£l^>r<;h$^B 
« 5r-t-^ * & £ t ti "TflgT'$) & Z t IZ&Mt^Z X'$> 

<r>nmth v^y^tm tmsmimzmftx'* hzt 

l . ^yr-^ny i 4 0 6. av. nyfcfW7-f 

3yi4 04#. n<?)ffiittf)ftmtt-t&Tyj*tmj& 

[0 1 16] Hie. S-f^^U- yH^tc 
^^flTI-^^**. LiveBoard^-yW'f 
h/My^'T"-^ 1 4 10i?D7^1 4 1 lt$>*„ 
^-i^'fc^-f Wr-? 1 4 1 0{4. n±<0Z<0 
ISratCL i v e B o a r d£0±T-?S^El.^ilTV^ 
-i?" ZiF-f. ?u y? 1 4 1 1«4. H^«f|S|$:^-r. 
7-7^14 0 911 •b7i/3y* { 5-f^y'J:Si 

[0117] y*7U-^li, W±^m^:r>ti 

mmiz$£z_Z>t:tblzteoWi>X'Z h , ZtL\±. i-Hf Ai 

m^t&mizx y^^ &A(cfiHo*£ t 

r-fny^MLT M?^yhLT^y-y^-T&" 16^*2 

io^siis. Mt. MiRztifc&mizmLxtim 

mz<k<0&^W!k$:i;-ry7l}-£Z>c\tl,z%&. Miz, 
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It. MWZtltiT-l ^>i:mm^-ft>tl^<.>hcD<X 

<?M yxfyx^wJ* yyWffjbtLZ mm. 
i/'i^-fWMyy^l4 10li, Live Bo a 

lz. "#4 > b IT 7 V mm^hti 
) . zcoXoiz. z<vmm-T< yf-rv—^ 

it. -fe y^a y^B±5r*iJffll-tS^^^|g^»f^-«. . 
[0 118] s-f-fy^UHrtt, 4J*rf&ifc36« 

■e* &m«cr>m<?>4 o b tart* 3 ttstf^ixs^- 
tfh&. mm. »«vuiifl#*«v^*fcTv^t3&»* 

*vv*4f 7rts fc#>£ , v r^3yi4i2 

*Wi W 7-in>141 3&J10tt-&£ 

s. 

[0119] ^£T#ra%M0IMK<OL i v e B o a 
rd^-iyK'Xi, LiveBoardN^MJ- 

LiveBoard>)< yHW, tffi£ 
OTi vo 1 iV7h'>i7Ca^<. Li veBoa 

H, &l>\ (nu 1 1 ) " *-K*C*4. 

-f'yR-b'Cfe^til LiveBoard->^y 
K**tt. iCiiSitJtWWrT'. LiveBoard;^ 

Axuj-A ( -r&jb*> ? -4 kx? yy^titzmm u .x 

b) ">^y?sV7-it-)V %-K(C£ 

©) L i v e B o a r d«9:RJRA<fi^3*U 3f 

/i/'i? M:Wff bfc>f <y haWS*. *7Vx? btf 
>\4=74 b^it. /}-VMZ£K>m>bZti&. "rf 
Vyyy7-X-iV" ^-KfciSWtti, ij—V)V<rm 
\t^^yb mm. Jt7i?*?b*&fc*&tzth<7y<. 
y. *y i Jx.?b*mfr'?tz#><r>^. *7 : Jj.9b*m 
wth tztbcom t ) nrnz^rftzMzmtr h . 

<7mTW^) com *) IZM-fZ L i v e B o a r dcO&T 
Wmt^ttZtlZ . ^/l^- bit. LiveBoard 

i<a\ ZtU±JL—f£m?g&itZ>) . 
[0120] Ht-tJUTJis zt— X b b 

wmzmaemmt. *tim\mzti&ikx't>. =fA 

X7VA liz^yi?*.? b<?>1i*t irtc>*—i?a > ( Z<7> 
i-x b ) ££g-r. £<3&RU:* f izx *)*y * 

7t5;imS. ^h^'x?Hi. -fc-yi" 
a ycotf^TM ^7* •/ 9 X b Vxm ?ZbWT%&. 



[0121] T-J-i/ay^-bk'^yis-yr-tf 
->\s*:~b'\$. &«%ffe<r>mmz±tz>j ^ybnmz 
*k-t. j^yisyrx-^-Yiizti^Tit, x-v/u 
i±4^yb<rm* ! mt>-£z>ij i . yivr—x— ^a>t- 

-X-bZtifzfrlz£ *)4K.ybcom.*^?. 

[0122] m±mm\t. ~fi£.<7)mz$k^ztifz*7y' 

xi?htcOffi5^fflfcJ;0±tS. ffi&%MbLX. x. 
— f (S^T^x? hSrjMJRLT. LiveBoardi 

Tl437y H £l»tXtB-f i b WTS & ( Witf. 
LiveBoar d±fcrS**.fc«BI) . flfi<?)l|4i$lJP 

[0123] £T^L i v e B o a r d^«g$rfljffl-f 
^Ct^T'l'ScOT', LiveBoard^^h'i) 
tt. Xf'-f ?bLT«lft^-&Zb1)<T'%&. ZZT\ 

— m.^ztifz*-7i>x.7 b<7>ztiL>n%<7xmz 
*<7)£?%mmi. ztit>&M(7)j"(j*xbv-j> 

£mLZitZ>z\tl,Z%:Z>. 

[0124] LiveBoard^^W TV- 

^bmL®mmmconxb Lxmrn-zzbimm-cb 

•6. ma<?)S-b"r-*y7'i'XTJ>>btZ5&ilZ. Li 
veBoard^^VWIi. y-b^-^f-y^^ 

h» zl— -R$L<r>ffi(DfoL>Vp&&X''L i veBoa 

rdtffiit#ffln;k*>Ti5. fit. fiaji(f. 

JL— f ti-fe .y ^ 3 > LT , -b y ^ 3 y<7&tfj(?>ji& 
ICXdf 77L (mm7u y?±c?>#4ybRXS7 >J -y 
^l&fPlCj: 0 ) , W^^L i v e B o a r dd^iH^il 

ii lt ^.g. w±<?>-m ^mm^mm-htzibizzi.-^ 

[ 0 1 2 5 ] 0 1 5l±. SB#jST«^5U6®«^)L i 
veBoardf^ > K l 7£l&HJ§-f& „ El 5t#fltT 
Sk. LiveBoard^^H^lSO lit. -fey 
^3 y7?-tX7-?Xf- i^3 yJit'^ff^fLT i v 
o 1 i Tr'J^g y<OtzltXDZL— ¥4 y?—7x.— 
X<r>4 yXfyXT'foh. LiveBoard 1 )^? 
*7\i. mn&* hxU71 5 0 3 IZ&Z&t 

4M«XUT1 502*»^^„ (WxiJ71 502O 
«^tfO0JW5, LiveBoard^^H^lSOl 

?bl±. ^7y'i^ NX'J71 5 0 3tC«***l.!t-7— 
df-y^C'J)*. Sflky-/H 5 0 4*lttBj$^ 

H47-;H 5 0 411 SS?$ix^7'i''x^h(c: 

[0126] ^Sti^SS'J^. hOtttc:, ^tr/Vx? 
h^SJRLT«t¥V^I^<^COLi veBoa r 
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7*j : ^ Ybmm^hrth . *7i;*?Ht. mmm 
ut. 3snwic3e«s#i, mmt L-cntf stix. ma 

t» •eoffigco^-r^x^h&moftajL. it-TV*? 

#3r.r h TfcS . HRtt**£fctts k -> fc fciW*-f 
[0 12 7] Li veBoard^U^b'J-Ali 

^^hSr^rra. jg^suft-c^ji. j}u^->'x? 

«. #W*>f AXhU-AtcfcWttt, ffi«W*r:*3* 
[0 1 28] ^MW^-fAXMl-Ali. see. 

iifctttffltfti. fc L*>fAXMJ-A#* N fc'OJ: 

[0 12 9] Li veboard'^^H'Wi X*^ 
HTn— yco. &\Mt. *>f W 7x— X 

tmmLKmimwmmt Lxmn-zzttfTZh. 

?4J>,^4y4y?-7^-xk<rMmt. VXf\z.W<. 

dtih. ybru-y^-Yiz&^xit. mm?-i 
ax b y— Ateowc. ^T'^'x^ h^stnay-B^y 
-iKplaytool) eouftXHjLJi. sf^x^h 

Si-tifcfc:** ■IftfcWT'Vx^hfclW 

[0 13 0] ^MUI*^ AXh>J~.A«>4tefcttVvc 

WE-V-iVX'^V^ b*i£4yb-fhk. i/XJ-A 

it. *-fi/*? b tiau^to tt^vw 

^-fe y^a^SrS^-rSo LA>L3:A*£>. ^v-'x? 
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-Kw&hh. mats. htmmLtz^r^ 

[0131] W\<7>mtHt. S4^5rSftc05f^^x? 
bizfflMLtid:^ ^> hltx* vTt ZiMO hS 

[0132] LiveBoar d±.<7). ±fz. Live 

tl« 9Uv7\t. Liveboard^^WflSf 

3 y<?)H±<7)Wi^mX'h £ . ^ a -y 9 tf? o >y ^ xx 
x^-v— fc:J:"3*fR**ifc^7^ y^Jj-^x^hT' 

y?<v?T-Y*-7:JjL'?btmi s $>*)?lX1gitt-LX 
mW&hZttfX't'h. L* l L. 9uy9^~fV^\- 

U^ratc-fe vbZtl. 9 a -y 9 k mm Lfc&OjCWf < 

m^x. ?vv?{tztiu%<?>M.mfrt,miLi,tzmmb 
Lxm y )&ot:Mztiim~r&zkfi<x%&. f7^h 

[ 0 1 3 3 ] 7 o y ^ cO^gS^raJiS^. S -I i: *^T'# 

iii/'sxft- (JSftv #4 yhLxurnvx^h) 

t*iT'^S^-x-*«7K-yrr-y^-&. ^fL^^^b 

. *vm4. (f^^. inmm 

rtawra«*>t:aiBW- & t % iz-mimx-h^x-. h 
■?kt>mmxh2>. 

[ o 1 3 4 ] man. s— 7M y^tfcuT(4. 

-i»ra®«JR'9±{f'bitr^ift?tLS. LiveBoar 
£ J: 0 . i <omHzj y^r v?X ZttttZ Z k 

*. l*»u. 51^, wfMTOi-j-ts&^fcfteatifc:. 

?D7;fi4)£$ns. ^-?T. W«<^)BI!ttt2-JijE« 
^„ ^co»*{4. S—r-r yfcrm. Wu\^\t. \kXT? 
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mx'hh<nx\ t -> t i>^mz'$> h . ^^nts^fev ^ 

Ttt. ili^fiipixfe^H^SrgB^S-yrT. a— Tic 

[0135] JL— «f Ji. L i v e B o a r d*> -r y K*7 
(HT* If^tULi veBoard-)^^ 

LA>L. dcotffolciSVvTkL ^o-y^OfigflSPiIHi. 
W±'y-/l^Si£<^B£j&t-fe «y b SftS t (JTCfc 0 . 

T9±Xth3-— "f^i-h. mi. 4 

— =f< ?J-$-W#, 5— r-f V^iatc-f yx-y?x£f+ 

tt^it^-afcMMeT-ff^rftlK. *£t\ H£ 
<F>z\<r>&X\ mi?u-v?Z$L&Ll,. &.^X'Z<rmi.zy 
— h*?4~rth„ Zcr>7v2v7i±^ S-f^^ 

[0 1 36] *7Vx?hfcRBSL*:£-C?M'<.yh£ 

urura* u*. mm. a.— m. * 
tvx ? hio^ffiv^im^co^atif^^ftis £ t 

$rStf*>t Ul3rv>„ ±j^L^:J: d (c. LiveBoa 

it. rM-i^'f J"f >-^-7x-Xt7)jg#;b-7-y^cO± 
^Wl LiveBoa r d fc :JM A5 
-f y^ >-^-7x-xcoracOffi»(4(c:J: <0. J— 
^t3tWilJiP'S)-l.-fe>y^3^cO't»^cO>f yr^xSrSt 

[0 13 7] Li veBoard^yK^fc^ffiSfP 
JflKifcttSMfo^OiaftU:. 121 6-02 OtcML 
T^^n&OT^^-T-'J^T'gJBB^fL*. L i v e B 
oard'>-fyb''>i:^'fA7'fy'(y^-7i-XO 

»£. Li veBoard^OF^iflXiJTt, 
^ >f ^ ^ y >f > ^-7 x -X^SHUNfra h 7 -y ^ ^ 'J 

[ 0 1 3 8 ] 0 1 6 fc . JL— f JiL i veB 

oard'?^b''/1601ttMlt. C^SH^ 

m^mmm (zzx-a. ^y/^^m.mhxm 
mzmmtsv > ^welt, 
i 60 2cr) "%w iwm-h. jkwc. i"(M.y-i> 
a >?-yn-x i 6 o 3«. mmziitzwmtm&L 
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-o-^-^i 6 04ii. wmzmz&w^yh&m 
m-z>. zomxit. nbnj^yhii, mm t 

[0139] mmiz. ?JJ±7 4><1>?-yx.-Xl 
6 0 3X'mPnZtlX^&<r)li, B£B#F§H 1 
6 0 6T'$>£. *£T\ mLtemM a %w & 

mfrixtz "w (n&x-ibh z k tca*^-^^ & . 

[O14O]017ii s Li veBoard^^F") 
b 9 A A5-f y?-7x-Xco0cO|?O$£t)Wt 

(*K50B4B#ra^ VS/*—* 1 7 0 3tt : Jz.T)\>A >i> 
f-fl 6 0 4Ojtsrr^#irr-g.. LiveB 
oard-7>f y^l 70 1(1, *> J: d k' ^^WtCL i 
veBoard<7>±C^>-5 7tt>c7)?:*^-fS^{C 

#(3, si 6ttmzti.tzi$. mm "xw 

{±L i veBoar d *74>Y ^Izmh-^Zt^iM 
-f<ZX'$>&. 

[0 14 1 ] S±nv>-K^Wm$iiSt . Live 

<0M;fr«, |i]»!LTMff$ti.&. L{f^<L"C. mm 
"%W It. LiveBoard \,ZWx%> . 
[0 14 2] C^T\ jl— jM!Rh9-y ^c7)±co-f 

h -5 £ t iz%.tfi-o < . 9*« . ^ A y A ><r) 

^5:SiRL. ^ac. 0ffltfOMJt5LTl->SW*{±L i v 
eBoard')^yK'/T'A^^ hZtl&. ttb 

*>. mmtfj >com5.mmiMJiftV£x'&&. 
[0143] ztuz. m 1 8X'mmztiz> . tvxr;p 

XI 8 0 3a>£gtR3*U>. LiveBoard 1 )^ 
N71801 tfcV>T , 'VP— 9— (route 
r) ' 180 2«±^-f (ZZTt±^Mer>Pi 
■C^Lfc) . tot. t'ya7/H>'y7-^l804 

dtjwi^^yMi. mat "/p— ^— - fcsra-wfc 

[0 144] iXtc;. 3— Liveboard-^^ 
>'H'>c7)H(7)±-C*V^ y^X^l,S < , -tLT. ^-y^ 
XS-MlR-r-g.. £-5«t'y' i 7;Hyyy--^(i, 

A^y^y^i-x (^^Ji. z-pcob'^'xT^ 
-f yx^-^Ji. fi»h7-y2?±-CVN-f b-rS£k 

* { t-#§) <7>MVih7v7±t,zm^zix2>. mi<omco 

h'y'i7/H >-^-^{i, ^ y XCOJt^O^-f < 
>-b$r*L. SS2<7)ScDb'^xT/M>'^-^{i, ^ 
■y ?xt<±< Ztltzmizyj yifi^SE-Y^y hSr^L, 
S3^)I(?)h'y'a7;k-f y^-^ii. Hffi-ttfotfv? 
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[0 14 5] £*itt. HI 9T8ffl?fii. #7?X1 
9 0 2fi. LiveBoard')^yK')1901T'A 
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9 0 6Ji. ^A5^W^-7x-^1903tA 

*fc*JV^TIi. S^OtyaT^yy^-i'll 4^ 

[0146] x~ (ffcfc. if*, iKStiffllWSfrt' 
x*.xT/M V\?*r-9 1 90 45-M1K1-S. 
[ 0 1 4 7 ] iXtc. ol— tffi, 0ffi<oS!l<yy<— >-V)_L<0 

I). :MA54ycDg|^#H7>fe?^3>"#yW 
Sfl 1 <7V>4 54 h Sftfcffll&cObVxT/M 

- * (cf?i> Ls >5:-t?3fli s> a yifi&KZtUi 
[0148] WStfOfirfiT'^T'^x^ l£u 
Xfoh* d>-Xb*~7iS*7 Mi, -fe -y x 3 ^ct)Pb1^ 

^-fr%$imXh&. JL-lfU:. m«V>*7i?x.9hzf- 

fcf . -fe y ~> 3 y<7)^>9 ictJV^TJia^HS^C 
■d-x h^7>'x ? McJ; DBBt*H;^-SJiacoy * 
M . 

[0 14 9] Clixte, 02O-Cit9i&tiS. 02O£# 
H§-ri>i:. JL— ifte, LiveBoard-)^H>)2 
00 lcOE|c7)XUT2 0 0 25rStRL^. m#t=0 1 6 

^#os-f- 1, t . xur 200 wmcvvxb. 
to" , , zttf. s-#oxurt;« 

^4A54>-4>-^-7x— X2 0 0 3Ji. CI 
^T/n4 54 hjSft^f&^tVxT/M >&r—9 2 
0 04-20 0 6S:W-rS. Cfl^fi. XDT20 0 2 
fcSaLJt4^>bt=«J[5-rS-<<Vh. * 
* . . Rtf. "KM:" tBWt* 



£*U2, J|lt=SIBWsarffllJrc** 

^>-hti5]8H;^4 54 hsnitikcffirr^STft 
wiz, la2 0fcli^BB$i^rv^sco^i, -=f-xK 

^TVx? h2007TJ)l.. B*co.rcoj±rc\ "=r- 
Xh" *:/i;x:?b2 0 0 7K:£9^S^ft«<5D:+:7 r 
>-*x 9 Hi 2 0 0 7Utffl9*Ufc. 
[0 1 50] _B£U:J;3l;:, if^ll. x-if*s^ 
m?mz9 4 AX h 'J -A 4 h t-9 Sr#irr?» 
-I^fTf. LiveBoard^^Wlf^ 
t LTV^tfcb#l*J&». W**SBft£;fl&jW2. Live 
Board ttimSftfcfrUv?-*^) ^ 

±<7)V-Jr >^-C£>£ . Z^m-Slza. LiveBoa 

£o%MM<7)mMkkLTfii?ii&. ft\<r>94J*x 

[0 1 5 1 ] X.¥<(9tLXi&htlhtZ, LiveB 
oard^^hm itmti&l) «SM&3*Ufc-fe / ^ 3 

^^•1.. iWi, g|5^Wfc{±. LiveBoardO 

ktfX'^hfrtoX'&h* ZtM. -y >- 3 ycrm& 

<?m}i<?>*. 7^3 ><0*?*>Ofcfe»tS L i v e B o a r 
d^^>-K>>S-^-rH2 li:a2 2t2|«LT. t-^fc t 
J:<^^.^S. ^M<OLiveBoardll A*^ 

> is-y 9^-)vm±^— Yxmat LX v i& . 
[o 1 52] @2 i&mm-t&t. 

*>9tfL i ve Bo ar d^>f yK->210 1 \,ZWx 
*V9~\t. t'/yg >-«0(f ^4 >"T -y 92.*ttliht&> 

izmz\b* { x'%&. LfrL%tft>. mh$-^<>9 

<r>m. ~?-*>9'W^<^M&mffl& (Mx.it. -7—9 
2 102) X'h^tin. fdKLKv* (0>Ji.«f, v-^2 

103) stc ■»snfca»«rjft3&»»* 

*«Li veBoard^LTti^rtCtfiit^ixt^^^ 

[ 0 1 5 3 ] 02 2fcL /itt^iffimL7tm<7). 02 1 
cOLi veBoard^-OW^IffS. 022$r 
#HB-T.|>i:. ffi*$n!tLi ve Board>)^^ 
220 1IS, xf-( ^tcJ: 9&3fi^±ie£jlUo£-£6 
tZiblZtimZtvrz. MMZtltzL iveBoard^-f 
>Y*7 22Ql\±9V"/9 *mm LXt*A b * If A 

u -mz«7)4>T ! v9xkmm*w£*&. 022 

(c, T-^Xh^^co^a-y^hMii^t^ix^. ^C: 
T\ M;tfcf. 7 v d E -Xh2 2 03Ji:. V-^2 10 3*«M 
*»*i-ft*»** , tfc«>tett'5 Z bifiX^ h. 9v -v9 

b 2 2 0 212. yy^umm^m-r 

1)\ Z l X . M^-^ y/«4«WI4 o 

-f. HH^>j6»t. li^LiveBoard^^yf' 
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•712, <J:^^IIg#*^M^at LTLiveBoa 
[01 54] Xf^tLt, Li veBoard^-f 

4. ziiii, flaRIf, ?4VF?<^o£tt#<3&S£< 

2 \<7)-?—*y?2 l o 2*ffltlzibte'fi oZbtfX'% 
4. 

[0 15 5] ^^iXMJ-AT-^ff 
4. jL-i«i. 8ft3*Lfe?4 ^h'J-A N * 

mm/&m<7)i:¥M<o<?)MmizmtfT7 -tx LKMzm 
mhiz. m^&mmsmztitzzza&zbiz 

\* LtiibtfZtii MmtX^tzbbii LttSBtf . 
[0156] jl— fUmii. 54 AX V V -AT-^tt- 
fl-xXy-tf-hZtiZ. L*>L3r#£>. Xtttt. -fe y 

W£%)mmz5-l htz>b<?>3--*f4 y^-y^-xy- 

[0 1 5 7] ;M AXMI-AT— afT^^-rkt "(W 

-b^rbx;^ (esmbMfflZffli&Zith) 
-mwtfimizK&bz 

[0158] m&$tLtz* 7^3 ;5M AX b 

<^»>^x^°V^^^--t -f Z b W 

*ffl-cj>4. fflW<yhl±. *L~vi'v><7>£x<r)'?-i 

[0159] \^<r>fr<?>fm.cr)mffltfhz> . EmztiK 
^-^^-^fr^mmzn-i^h «r t &x- 

£4. ieS*?ft£»4£KK*>jL4^,t^DT?-fcX 

4 4. T^-fcxte. Sgtrdt^*^ 

tg&T:?-feX. frU^^Srr^yh'-fS^i:^^ 
T?-feX, Sff^^^ftt-S-fc^^r^-b 
X. igv^ T9**MWZ$tWthZbtWffi&T'? 
*Acr>£o*c^ m%itzMb-t&ZbtfX'ZZ>. Ml 

is . n-i^m. 5 — f * vr*m&r$iw $ 

*-£WT?*x$rJiai£^;t4.LtA*T'^ 

y^m\mtsi^t^mm^^m^tifzm\i>zT^ 

yY-f&zb VX-Z . ^^jfficofa<o<IA^*<*f #$ 



fc**T£4. 

[0160] m&iz. ym<r>m syrzm&t&zb 

cDtitbiz) <v£olz^ mtt-iK&rmiZJt-is-fhZttf 

[0161] ^>fi»XhiJ-A7-^f?ftli. sum 

^<0««<9«j&gl!i^^J1W£-ft*t4. t§^<7)^< 
-r*ik**TS*. ?M ^h'J-An — - Yb?4J* 

0. ifctt. #5£<7) ^'f AX h U - AiOr— ? 7 * - V 

-t^*7 , -^t«a»*'r*3&» ( "•fe'aT'S^S" ) . 
«fc:mLfc**fc:L-c*J<ii:fc«I:»)fi«Srffilfrr6*» 

[0162] vmizm-i^tziimx'Tf-txmmzmm 

h*Sr*LTV^4i:#£S. fcfci, 1 O^X/^^t* 

«±arv». L*»t«f*«6, mmm%imbLx. mmz 

[oi63] mm-^^-y us. jl— 9**^<x4>*s^tc 
ins; Lxmm-th z b tfx- » 4 ^icc^w ffl-cfc 4 . 

4. 

[0164] ^^TWjMrSOfcJIMSifciJV^Ttt, 
-9 s tc-fe -y v 3 y<rm<r>-*-"r < *<r>%m.\zft~th&z. m 
<0W»*#-i6/£»t:. -x-iM >-^-7i-x-y-yP 

^M*=5r-fe y x.-~wzmmmtffflte 
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<7>±.<7)ft^j&)<Z.tl$:?rO . L i v e b o a rd(:-?^ 

ftS . k fciWW^IWiW^ K#?y 
tt4*-XWy»fiEI|i|!^i; s LiveBoa 

tbiz s mm*$> a swatter* & a>o i vf frx-b zfrim 

m-li*^. -r=5rfc*>. Zti&tftbitiXfr^tthk 
tMoT, ;KXI-*>y7 (post-hoc) ffl 
[o l 6 5] flj^<7)j--if^ y?-7i- xti. "!2#£ 

t (#-xtie»fc3Sai*c) ate* 

fill, -b ^ a y+fcat £**8&: i 0 - JL-iW** 
ZkX'h*). JL— f -b >y a XOgPfl^ieii:* >T 

[ 0 1 6 6 ] -b y a >mm-?&t:MZffli&Zitt>tl 

ik. &mt& u nm*>" im*y#*>k 
-&izm^£ti& . tm*yx?>tfwzti&k, 

■fli. W%&XT8LM±N#m<m&X\ -b-y^a^te 
m i *7X'&$>Zk£~?-7't&ZktfX'%&. mt 

Witf, 5^^-fe<y h-TSClt^-C^S. |s]^c, -b 

*\ fEU* > > 4: -*f tefUS $ it . £:h.£<}: 
0 . J— y-dt-fe 7 y3 > tcKtl*^ ytJf, & i i: Sr 

9-r&z\k&x'*&. ®ms. imtm&<?pitzk% 
tc, iB^<o±tcsf*<o i ottii&^mrzktfX'Zh. 
ztth<r>mm\t. i-if^f^-t y ^ 3 ieih-^ 

£*^a>$ri*5£-t£ £ £-b y a y^mh 

[0 16 7] Cix4.c7)J--^y^-7j;-X^-;U*< 
fro z kit. * visa ycomizfflW't^yhZ 
hc\kX'$>h itm*?*? tVYWS—iSZixfzk L 

hkLX-?—7Z1Xh. ) . -b-y^ay^W^Lfcf*. 

ro-fexii, ^e-r&jgje (-r^*>. t'/ya^m 



$Jffli-<'<>h5r^.T. ^-^3-;^SB«t-€-ix<5>^ 
i»Jfrt-!> J: 5 (=Htt i k *<T-£ S . 
[0 168] dm-f >f y^-7x-X«-o«Ht 

zm*y*?>zwLtzmz. 

XlZttt&s -y ^ T -y 7- £Ml ^±fS#<50'^^^ - a- 

[02] *fH8^«iS^»3teW«B«fc:*iV^T 
^iJffl-TI. i fc S -b -y x 3 >-T ^ -fexv-iy xf- 

[03] *ISH3^3«B#^-CcO»3i^llSfSS«tfO-b -y ^ 
[ 04 ] *f|B>1^a^r'^0®^IIJS®«O-b -y ^ 

U-f cob's; i7*i- if 'f V^— 7 si—xcomx-ht. 

[05] ^BJ^^T'COSFM^Hliffi^-b y =y 
3 WtztbCD? 4 £-7-4 yjL—fj >?—7 i-Af -f 

xru-fco0-cfti.. 

[06] «HR^h^-y^TVX^'fX'J7*i:^'S 

h74j±7 4>4>7-7*-x<7>m&\tztuzmx°h 

[07] 06co^^-*^I^W$ix-a(c^o-C 

X ^S»fpco«gmSr^0T'ftS . 
[08] roc0-b>y^ g yc0ll*S:SIJWI.3ti» , )C0^ 
Vi-f-f y?-7x-Xf^7I/'f yXf 
A^0T'J)|.„ 

[09] -o^RMSBrJiWS-fe /^^b *«««l*ia h 
9 y Tt;*^$ tt. mjtmffl b7 v7*V T 
x<m&*.7*V\-<r>Wm:isX274J*7A w 
7x-XCO0t'ft-i>. 

[010] H9<^uSWHIh5-y^xUr«W>fXtJ 
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[011] LiveBoard-y^ymiSW 
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[016] LiveBoard^^K^t^U? 

[017] L i veboa r d^^^H^t^-f 
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io, LiveBoard^^H^i^U^Wy 

* - 7 x -x«pwn!W»t |Hjt-to5r Riflnr a is] W-ft; 

$il/v!T -<X7M ftjgf* a . 
[018] Liveboard'>.(y^tNA5 

y^f y^-7i-xoH»w<!Dit*&. 
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a. 



[019] Li veBoard^-fyK^t^'fA5 

7x-X<?)[gc7)ffl|I8tt«90T£>l>. 
*>. ^57 4 7?*/yi? H;oi^^f ^y 

[020] LiveBoard^^yF>>i:?U5 
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[02 1] LiveBoard-^^yK^ft^ 

iveBoard^^yHWJ^SWtl.. 
[022] LiveBoard').fyH'>*ll^ 

iveBoard^^ K^<90!l£«flW-S . 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] A computer control mold display system for controlling playback of a session gained with two or more media 
capture equipments characterized by providing the following At least one of said two or more of the media capture 
equipments is share expression media, said share expression media generate and display a graphic object, it connects 
with one or more players for said computer control mold display system to reproduce said session, and said computer 
control mold display system displays. A cursor controller for enabling a user to act on mutual [ said / computer control 
mold display system and mutual ] That to which it is a session input means for receiving temporary data of said gained 
session, and said temporary data changes from a time stream and an event Are the processing circuit connected with 
said session input means, and it consists of what generates display information for a window where said processing 
circuit was displayed on said display. Said processing circuit is a share expression media emulation circuit for 
generating display information from a time stream expressing an interaction with said share expression media for a 
display of the 1st window of said display. Said 1st window As a player for displaying temporary sequence of marking 
visually by said share expression media Moreover, a thing which functions as a user interface for controlling playback 
of said session, It is a time-line generating circuit for generating display information for displaying a visual indicator on 
time line of the 2nd window of said display. What each of said visual indicator expresses a temporary index to said 
session to corresponding to an event, A user interaction of either said 1st window or said 2nd window is detected. A 
user interface control circuit which is made to generate a control signal over each of said share expression media 
emulation circuit and said time-line generating circuit, and updates said the 1st window and said 2nd window according 
to said user f s interaction 



[Translation done.] 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to the field of the multimedia capture of a 

session, playback, and edit. 

[0002] 

[Description of the Prior Art] the meeting by which most groups 1 work was structured ~ even when arranged setting 
[ like ] is performed, you can understand in common the modality in which the gestalt of a casual interaction like an 
exchange of the language by conversation is taken, and a group has the technology of work of them, a process, and 
relation by this. The focus of this casual activity suits to the result of such an activity, and it is not fully supported 
depending on the almost disregarded tool of computer use about how the group reached those results. Furthermore, the 
attempt which collects such information has resulted in making a participant follow a convenient method at an 
information gathering tool considering the activity as a formal thing rather rather than it supports the practice of natural 
work of them. 

[0003] Collecting the audio of a meeting, video, and computer records offers the record in which sufficient examination 
of a group process is possible. Though it was regrettable, the advantage of such record could not tend to treat easily 
because of often needed sequential access. It is possible to access such information immediately with such the advent of 
informational digital storage. However, immediate access is useful only when the location which should go is known. 
Therefore, it is it is required and desirable to attach an index to such record based on an element with semantics or an 
event. 

[0004] One approach of attaching an index is called real-time note taking (Real-Time notetaking). And people use the 
system which carries out a time stump to each various elements of a note, and take [ then, ] notes between meetings. 
This offers the index in which an understanding to record of a meeting is possible. By only choosing the element of the 
arbitration of a note, a system can search the portion of AV record corresponding to the time stump of a note element, 
and can be reproduced. 

[0005] The easiest example is the copy system of a sentence, and a user only types a text there as a meeting progresses 
(a text can be considered as the note of the arbitration about a literal copy or literal meeting of having spoken). A note 
consists of the string of a text and the note element by which the time stump was carried out is the discrete character of a 
text. After note taking is completed, a user can choose an alphabetic character, and the portion to which meeting record 
corresponds will be searched and reproduced. 

[0006] A note taking system enables a user to constitute a visual expression (namely, note). And the visible element 
achieves a function as an index to meeting record. Each index element has the time amount related with it. This time 
amount is the time amount to which the user generated it. Since each index element is visible, a user can only choose it 
as it with directions, and since it has the associated time amount, the address can be obtained to meeting record. 
[0007] A note taking system operates good, as long as the structure of a visual expression consists only of the sequence 
of the element which generates an event. If an expression is allowed to be edited between the courses of a meeting (i.e., 
if element modification and an element-deletion event exist similarly), a problem will arise. An index is a visible 
element and the cause of the problem is not being an event. 
[0008] 

[Problem(s) to be Solved by the Invention] The disadvantageous point of the approach by note taking is that people have 
to concentrate on work of note taking. Therefore, it is desirable to generate an index into meeting record without making 
people concentrate on work of note taking which is the natural side effect of meeting activity itself. 
[0009] 
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[Means for Solving the Problem] This invention aims at a user interface for controlling playback of temporary data 
expressing a joint activity like a meeting. Such temporary data is gained by one or the capture equipment beyond it (for 
example, record or an electronic feltboard of an audio). Temporary data consists of a time stream and an event. A time 
stream is data with which the time stump of the set expressing an aspect of affairs in which a certain record of a meeting 
is possible was carried out. Record of an audio and video and hysteresis in which action on an electronic feltboard was 
accumulated are the examples of a time stream. An event is an occurrence between time streams. An event is used in 
order to generate an index which offers direct access to one point or a span between joint activities. A time stream may 
be analyzed in order to define an event as a proper or to identify an event. Event information consists of the various 
properties of a time stump, an event mold, and an instance of an event. 

[0010] Playback of a session is performed under control of session access equipment. Two or more players for 
reproducing a time stream were connected with session access equipment. Session access equipment uses event 
information, in order to generate a user interface for controlling session playback. A user interface consists of two or 
more windows. Each window can express a player, a playback control unit, or an editor (as for this, a user permits 
generating time stream information on additional). Two windows are used in this invention by the coherent way of 
carrying out a having-two-incomes operation. The 1st window achieves a function as a player for reproducing a time 
stream, and an electronic feltboard is used in order to control playback of a session similarly. The 2nd window achieves 
a function as a playback control unit using a time-line metaphor. In the 1st window, each marking after an electronic 
feltboard expression is related with one or an event beyond it (for example, event generation, event edit, event 
migration, or event deletion). Selection of marking makes it possible to be moved to one time amount of an event with 
which playback time amount was related. When chosen, an event is displayed on time line of the 2nd window. On the 
contrary, when a visual indicator of a time-line window is chosen, an object to which the 1st window corresponds is 
highlighted. Such coherence enables a user to set up an aim in a point in a session which probably includes interesting 
information correctly. 
[0011] 

[Embodiment of the Invention] Drawing 1 is the block diagram of the system for acquisition of temporary data in this 
time of this invention, and a suitable embodiment, and playback. Drawing 2 is the block diagram of the session access 
workstation which can be used in this time of this invention, and a suitable embodiment. Drawing 3 is in the false 
condition that actuation of the session access workstation of this time of this invention and a suitable embodiment was 
simplified. Drawin g 4 is drawing of the visual user interface of the display connected with the session access 
workstation of this time of this invention, and a suitable embodiment. Dra win g 5 is drawing of the time-line user 
interface display for the session of this time of this invention, and a suitable embodiment. Drawing 6 is drawing where 
the time-line interface which highlights the relation between general-view time amount truck display area and focal time 
amount truck display area was simplified. Drawing 7 is drawing showing the result of the actuation into which the focal 
bar of drawing 6 is extended and the size of focal time amount truck display area is changed according to this. Drawing 
8 is drawing of the time-line user interface display system for controlling playback of two sessions. Drawing 9 is 
drawing of the time-line interface with which two discontinuous focal segments are displayed on general-view time 
amount truck area, and focal time amount truck area includes the details of each focal segment. Drawing 10 is drawing 
of the time-line interface in which the result of size correction of the focal time amount truck area of drawin g 9 is 
shown. Drawing 1 1 is the example of the time-line interface for playback of the session recorded with two or more 
capture equipments including the truck section produced as a result of selection actuation of a LiveBoard window. 
Drawing 12 is the further drawing of the time-line user interface display in which the result that the truck of the audio of 
drawing 1 1 was merged on one truck is shown. Drawing 13 is the farther drawing of the time-line user interface display 
of drawing 11 which shows an open beam result for a note on a note truck. Drawing 14 is drawing of the meeting player 
about the same session used for generating the time-line user interface of drawing 1 1 . Drawing 15 is drawing of the 
LiveBoard window in this time of this invention, and a suitable embodiment. Drawin g 16 is drawing of the functionality 
between a LiveBoard window and a time-line interface. That is, it is index attachment by the time line from a graphic 
object. Drawing 17 is drawing of the functionality between a Liveboard window and a time-line interface. Namely, both 
a LiveBoard window and a time-line interface are in the synchronized display condition reflecting the same thing as 
coincidence. Drawing 18 is drawing of the functionality between a Liveboard window and a time-line interface. That is, 
it is index attachment by that of space from a temporary thing. Drawing 19 is drawing of the functionality between a 
LiveBoard window and a time-line interface. That is, they are many events per graphic object. Drawing 20 is a 
LiveBoard window and the chart of the functionality between time-line interfaces. That is, an index is attached by the 
location of object area. Drawin g 21 and drawing 22 offer the example of the LiveBoard window in a "BAUNSHINGU- 
ball" playback mode before and after editing a LiveBoard window. 
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[0012] playback of record of a joint activity [ like a meeting ] whose this invention is, and other together non- working 
activities providing . 

[0013] The purpose of this invention is generating an index to meeting record of the joint activity which is the natural 
by-product of the activity itself. This offers the intuitive method of obtaining a part of direct access of the session when 
people were recorded. An event like taking modification of a speaker, the writing to a feltboard and marking actuation, 
and a note is the example of the natural by-product of the meeting which offers the useful index point. 
[0014] The system of this invention is described with reference to the time stream architecture and system architecture 
based on software. Time stream architecture describes the software framework by which this time and a suitable 
embodiment are performed. System architecture describes the component of the function of this invention. 
[0015] The term used by description of a time stream and system architecture is defined here. 

[0016] A time stream (Timestream) means the media data which was gained with capture equipment and by which the 
time stump was carried out, and can reproduce it with a player. 

[0017] An event (Events) is a shift of the occurrence generated at intervals of a certain point between the activities 
gained, for example, a speaker, or the writing to a feltboard. 

[0018] Temporary data (Temporal Data) means association of a time stream and an event. 

[0019] The collection object of temporary data expressing the activity gained by sticking a session (Sessions) like a 
meeting is named. 

[0020] A player (Players) is the gestalt of the origin of it, or is the gestalt which shows the dynamics of a time stream, 
and can reproduce a time stream. 

[0021] An editor (Editors) can change a visual indicator or means the user interface which can add an event and a time 
stream to a session. 

[0022] A playback control unit (Playback Controllers) means the user interface by which playback of a session is 
controlled. 

[0023] Capture equipment (Capture Devices) is equipment which gains and stores temporary data. The capture 
equipment of a different mold gains the media (for example, writing on an audio, video, and a feltboard) from which the 
session differed. 

[0024] Time stream architecture supports use of the tool of the harmonious record and a set with the expandability for 
playback. Although this exists in one address space of a specific machine, it is based on the distributed object system 
which enables a user to build easily the object which has the "substitute" object which exists in an address space which 
is the identitas of the identitas in a network, or other machines, or is different. This distributed object system is called 
the unification (ILU) between language (Inter-Language Unification), and is described in the "ILU manual" by Janssen, 
the Xerox technical report, and ISTL-CSA-94-01 January, 1994 [ -02 or ]. The fundamental data components of time 
stream architecture are an event, a time stream, and a session. 

[0025] An event consists of a certain possible property for which it may depend on start time, a period (it is probably 
zero about a 'point 1 event), a mold, and a mold. (For example, a LiveBoard page event may have 'pagination' and a 'page 
title' property.) The interface to an event object is as follows. 

TYPE Event=CLASSSUPERCLASS PersistentObject ENDMETHODSgetType():String, getStartTime():Time, 
getDuration():TimeEND[0026] Although the interface specification expressed here is carrying out the style of the 
assignment language of the ILU system mentioned above, it can be literally come out of it as it is, it cannot mean a 
certain thing, and can translate it easily by the person expert in object oriented programming. The semantics of a data 
type string and time amount is obvious. Additionally, an event is getPropertyNames():StringSequencesetProperty 
(name:String, value:String) which inherits the following methods as a subclass of PersistentObject. 
getProperty(name: String): String[0027] An event is generated by the call to a session object as stated below. 
[0028] A time stream object is used in order to refer to the data stored for the predetermined media mold. Speaking 
generally, the data relevant to a time stream enabling access based on the time amount of the recorded media, like the 
recorded audio, many digital media are related and the translation of data which consists of the data time amount sample 
data which this was able to consider was an event, for which it depends on media in large quantities and greatly also 
although kicked (again - equipment) and by which the sample was carried out makes it much more practical to regard a 
time stream as 'opaque'. That is, time stream data is operated by normal only with the special tool connected with the 
media of a time stream, and a format. Especially data is generated by the recorder object and reproduced by the player 
object. Similarly, in order to make an event, the specific tool of media can also analyze. (For example, a speaker 
segment, silence/interruption, scene change, etc.) By dealing with a time stream object as opaque, it should be cautious 
of the ability of architecture to be adapted for analog media. (For example, a recorder and a player may be the video 
tape recorders controlled by computer software, but a time stream may offer the software equipped with the information 
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for which the tape should be used, and the absolute time which should be related with the start of a tape.) The interface 
to a time stream object is as follows. 

TYPE Timestream=CLASS SUPERCLASS PersistentObject END METHODS mediaType(): String e.g. audio format 
():String e.g. sun au startTime():Time duration():Time END [0029] Sessions are an event, a time stream, and the 
collection object of the layered structure which may contain other sessions. It should be cautious of it being a wide 
sense, for example, a predetermined meeting or the 'session 1 of the narrow semantics of the data relevant to discussion 
being a special case from what this use of term 1 session 1 sometimes encounters. A session is a general-purpose 
bookkeeping device for essentially organizing time stream data. The interface to a session object is as follows. 
TYPE Session = CLASSSUPERCLASS PersistentObject ENDMETHODSgetTimestreamByName 
(name:String):Timestream,getAllTimestreams():Timestream Sequence,getSessionByName (name: Session): 
Session,getAllSessions ():Session Sequence,createEvent(start:Time,dur:Time, type:String, 

props:PropertyList:EventEND[0030] It is extensible in the semantics that the set of the mold of the media which time 
stream architecture was sharing the common interface with which the player and the recorder object have been 
independent of a media mold, and were supported is not being fixed. The simplified interface to a player and a recorder 
object is as follows. 

TYPE Player=CLASS METHODS seek (t:Time) Playback time amount is changed into t. location():Time It returns to 
the newest playback time amount, play (second: Speed) It (1= usually) reproduces with a velocity coefficient s. 
stop() Playback is suspended. ... 

attach (timestream:Timestream) A player is set in order to reproduce a predetermined time stream. END; 

TYPE Recorder=CLASS METHODS record(), pause(), createRecording(session:Session,name:Name):Timestream, 

finishRecording(), END; 

[0031] The player about a predetermined media mold and a recorder object are carried out by 'MediaServer' relevant to 
the media mold. Although supporting a new media mold naturally needs operation of new MediaServer, change of 
architecture (to namely, interface required whether a recorder and a player are made and in order to control) is not 
needed. This can write in general-purpose application (for example, a record control program or access, and a playback 
control program), and means that implementation of the new service about a new media mold or the existing media 
mold will be supported automatically. The description by which the interface to a MediaServer object was simplified is 
given by the bottom type. 

TYPE MediaServer= CLASSMETHODSgetRecorder(format:String, context: String):Recorder, getPlayer (format: String, 

context: String) :P layerEND [0032] The argument of the context specifies the information about a player or a recorder. 

For example, the host and device name which were used for the audio input / output can be specified. 

[0033] An analyzer processes the data relevant to one or the time stream beyond it, and it can be used for it in order to 

make an event. Such two analyzers used in the suitable embodiment at present are described below. The description by 

which the interface to an analyzer was simplified is given by the bottom formula. 

TYPE Analyzer=CLASSMETHODSproduceEvents(session:Session,specs:String) 

END [0034] An analyzer accesses the data of the time stream of a predetermined session, and generates the event 
relevant to a session. Which type of time streams (for example, an audio, video, etc.) are accessed by the analyzer 
depending on the mold of an analyzer. The argument on 'specs' offers all the required information about the method by 
which analysis is performed. For example, an analyzer can be used as the WORD monitor machine of the audio which 
generates an event whenever it speaks about predetermined WORD (they are some specs strings). The analyzer should 
be noticed about the ability to be made to operate on real time between record processes after a session is recorded. In 
the case of real time, the event made by the analyzer 'is observable 1 with other processes (refer to the notice of an event 
described below) like a process of carrying out a user interface. 

[0035] In order to promote this expandability further, architecture offers the broker object which arranges suitable 
MediaServers for supporting the media of the specified mold. A broker can assist arranging the object of other classes 
like an analyzer similarly. A broker can maintain the truck which must be performed in order that an activation process 
may carry out a predetermined object mold (for example, MediaServer of an audio) and/or may generate these processes 
using the information accumulated in the shared network file. The name service of other network bases was able to be 
used similarly. The description by which the interface to a broker was simplified is Type given by the bottom formula. 
Broker=CLASSMETHODSgetMediaServer(me 

An event, a time stream, and session data are stored in a time stream data base. The application program using a time 
stream data base obtains first the time stream master object which has whether other objects are made and the method of 
arranging. A master object can be obtained from the time stream server performed in another process (on host another 
probably) which uses the same device as what was used by the broker mentioned above. Or the program code which 
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carries out a time stream server (and master object) can be directly included in an application process. 

[0037] The fundamental step required for the easy record application by the pseudocode is as follows. 

... Master' The top-level time stream object called is obtained. 

session^aster.getSessionByName('Recordings' ) 

broker==master.getBroker() 

mserver=broker.getMediaServer('audio') 

recorder=mserver.getRecorder( f mu law', 'default audio device') 

recorder. createRecording(session, 'recording 1') 

recorder.record() 

... A certain code looks for the user interface event which shows what record should be a pause, a resume, or 
completion. 

... The routine for closing record is called. 
recording.finishRecordingO 

exit [0038] The above-mentioned pseudocode fragmentation describes the step needed in order to generate the audio 

record named 'recording!' of the existing session called record. 

[0039] The pseudocode required in order to reproduce record is as follows. 

... The top-level time stream object called a master is obtained. 

session=master.getSessionByName('Recordings') 

timestream=session. getTimestreamByName('recording 1 ') 

broker=master.getBroker() 

mserver=broker.getMediaServer('audio') 

player=mserver.getPlayer('mu law','default audio device') player.play(l) 

It waits for the user interface event which shows the thing for which playback should be suspended, or the thing for 
which different retrieval of time amount should be called. 

[0040] Time stream architecture assists the application which generally cooperates mutually, and offers especially some 
devices in which the cooperative control to many players and recorders is assisted. One device is a union 
(Confederation) object which is the collection object of the player and/or recorder which operate as a single player 
and/or recorders. A player or a recorder is dynamically added to union, or can be deleted from union. The description by 
which the interface to union was simplified is given by the bottom type. 

TYPE Confederation=CLASSSUPERCLASSES Player Recorder ENDMETHODSregisterPlayer (player:Player), 
unregisterPlayer (player:Player), registerRecorder (recordenRecorder), unregisterRecorder (recordenRecorder), and ... 
END [0041] As a subclass of a player and a recorder, it is suggested that union supports the method of those classes like 
playback and record. Moreover, union also supports the additional method of acting as playback of the sequence of a 
time amount range (behaviors). 

[0042] The code simplified for setting and controlling playback of all recorded data medium about the session called 
'ProjectMeeting#3' using union is as follows. 

Top-level time stream object called a master ... session=master.getSessionByName 'ProjectMeeting#3 ' 

. . .broker=master . getBroker() 

...conf=master.getConfederation('xyz') 

..timestreams=session.getAHStreams() for each timestream in timestreams do begin ...mserver=broker.getMediaServer 
(timestream.mediaTypeO) 

...playei^mserver.getPlayer(timestream.format(),'hostl') 

...conf.registerPlayer(player) 

end conf.playQ... 

It waits for the user interface event which shows how playback is controlled. 

[0043] It should be cautious of the identifier of 'xyz' being given to union. Other programs obtain this union from a 
master object, and although they control playback using this, they are made. Although this makes it possible to perform 
the program of some [ the same host top ], however in order to control playback jointly, probably it needs a very 
different interface. In addition, although it is the same as having mentioned above, the program performed on a different 
host can generate a player in relation to the host, and can register them with the 'xyz' configuration. A result serves as a 
playback tool of share distributed process input output equipment which does not need the programming burden of the 
addition for carrying out for an essential target. 

[0044] Another adjustment device is the notice of an event. A program can carry out EventNotifier which is the object 
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which has the method called for f noticeEvent\ A NOTI fire can be registered with a session object, and subsequently to 
the session, whenever an event is added, it is then called with an event as an argument in an event. For example, in a 
LiveBoard window, when some objects are chosen, the event which shows the time amount relevant to the selected 
object can be generated, the time-line interface equipped with registered Eventnotifier can be contacted (namely, the 
called noticeEvent method), and such time amount can be shown in graphic. This example is stated to details below. 
[0045] The problems of a synchronization are various joins and are generated with various gestalten. There is the need 
of saying that a time stream is changed into the condition of having fully aligned as it is not made to become irritated 
with the beginning like between perception of playback of an error between captures. In the case of an audio and video, 
this means that video and a sound must continue making it have to align in about 1/30 seconds (for example, before a 
problem lip synchronous [ irritating ] occurs). Since two time streams may be gained independently on a different 
machine, the thing using a certain common clock (or it rebuilds) is required for them among various kinds of sources. At 
present, in a suitable embodiment, while performing by connecting completely The network time amount protocol 
(NTP) stated by RFC- 1769 In order to maintain a clock within a ms at a precision, it is used between distributed 
machines (this is the protocol of an ecad). By only carrying out resynchronization to a common standard, it is not and a 
result better than usual is obtained by learning how the drift of a machine is suited. Suitably, although the time stump of 
each amount of the data of a time stream is carried out, the exact clock rate of the certainty of the system that a sample 
is carried out is enough as data similarly (since the real-time protocol packet was used by video). 
[0046] In other cases, in a comment of the sentence which attaches an index to other media time streams, the demand 
for such a strict synchronization can be eased. The metrics for which any errors needed again sufficient accuracy made 
not to come to become irritated between playbacks are applied. About the note of a sentence, a note means that an index 
must be attached to a time stream in the location enough near what the user meant so that this may be a functional 
pointer in the material with which the mark was recorded, the bottom of a certain condition ~ several seconds - falling - 
- although it is permissible, in other cases, even the fraction for 1 second may be nonpermissible If the user is running 
NTP on the hardware which is running comment software, generally as for the measurement, sufficient accuracy will be 
offered. Other options include synchronizing a clock with initiation of a meeting, in order to call a time amount server in 
order to acquire time amount current whenever a comment is carried out from a NTP equipment machine, or to calculate 
a comment machine, that of NTP time amount, and offset of a between. Correction of the gestalt of this last may use the 
gestalt of a special "synchronous event." It comments on this in the data beyond two or it of a distributed process input 
output equipment resource, or it can be analyzed from it. 

[0047] It is ready for operating almost regardless of the degree of the synchronous accuracy demanded, where various 
capture equipments are separated completely. This is desirable [ connection (a computer an audio, video, etc.) is not 
desirable, or ], when record is performed in impossible setting. If the means for finally aligning the clock of equipment 
of a different kind is offered, a hand held computer or a commercial camcorder is acceptable capture equipment. The 
example of the technology which aligns the separated laptop at record and the single tier of an audio is striking a laptop 
key loudly, and is an effective synchronous event. A keystroke is taken up by laptop, a time stump is carried out with 
that clock, an audio is analyzed in order to find out the audio event expressing a key hit, and the time stump of this event 
is carried out with the clock of an audio recorder. From now on, offset between two clocks is calculable. And one side 
of the set of a time stump doubles with another side. 

[0048] A drift (very low frequency error) is a problem similarly during the session to record. In order to amend 
systematic gain or loss depending on the degree of the accuracy needed in the session when the independent clock was 
adopted, or in order to carry out the repeat check of the clock for offset amendment, it may be necessity to read 
initiation and termination of a session. If data is collectable in order to propose corrective actuation ( 8057/8000 when 
[ for example , ] speed playback is usually a request playback ) , the drift in these elements of the system ( for example , 
audio equipment it was presupposed that was operated in 8000 samples / second although 8057 samples / second should 
come ) in which these selves carry out clock actuation may need additional fine tuning between playbacks . 
[0049] A jitter (still higher frequency error) is processed by generally carrying out a buffer in the suitable location of a 
system. 

[0050] The problem synchronous [ in a time in-stream playback session (it may often generate in coincidence with a 
capture session, or may be in the "nest condition" of the kind set to setting of a capture) ] is approaching further what is 
typically dealt with in a multi-media system. 

[0051] In order to set the context, it is assumed that it is accumulated while synchronizing closely and reproducing all of 
these time streams, or a desired subset so that various kinds of media time streams (an audio, video, count log) may be 
gained and the gained activity can re-experience. Furthermore, record is altogether equipped with perfect data and it is 
assumed that it was gained in the drift which should be amended, the jitter, or the condition that there is no offset. 
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[0052] At present, in a suitable embodiment, in order for various time stream players to approach moderately and to 
synchronize them, the non-drift system clock which fully synchronized is used for them, and they operate in freewheel 
mode. Each player is a method suitable for progress of a system time, and this means that there is responsibility which 
reproduces the time stream. In an ordinary playback speed, 1 second of playback (and system time progress) means that 
it should generate correctly for every second of original disk record, and this only expresses that there is much more 
much still quicker record by which a still later playback rate is reproduced by reaching, or there is. [ still less ] It 
reaches, the best expression of low speed playback is noticed about these high things customizable if needed for a user, 
and the video clip of the quadrant second which it may be wished in order that a high-speed pitch conservation speech 
may know a meeting roughly, or carries out a chain from a suitable gap may most often tell high-speed video recovery 
very much. 

[0053] Those with a thing and it to which two aspects of affairs of using a freewheel synchronization deserve describing 
are the opportunity of good initiation and a pause. The corrective action of such an approach is only dependent on the 
player which all start to coincidence regardless of [ the 1 st thing ] a transmission time, buffering, etc. It means that this 
should receive the request about initiation by which the player was planned (it is X system time (although it is few, 
playback is started to sufficient time amount (fraction of a second) to the future) at 100% of usual speed of the material 
recorded for example, by Y system time.). This mode of initiation guarantees the harmonious initiation to which the real 
time clock tenacity (Adherence) following a degree produces desired actuation. User action of specification [ the 
opportunity of a pause ] only is part synchronous amendment (for example, one player which should be a master is 
declared, and whenever a user suspends or stops playback, he synchronizes all the Childe players with it.) to a player. 
[0054] The block diagram of the hardware architecture of this invention is explained with reference to drawing 1 . If 
drawing 1 is referred to, the session starting module 101 will perform various "housekeeping 0 functions as preparation 
which records a. session. A session starting module is suitably materialized as software performed on the system based 
on the computer connected with various record components. Between the task, a session starting module must confirm 
having sufficient storage capacitance for storing temporary data which can generate session are recording equipment 
103 which can be used. This is attained by performing presumption about the length of the session recorded, and 
several/mold of capture equipment used. The capture session starting module 101 synchronizes initiation of "record" 
similarly by each capture equipment 102 a-c. Each capture equipment can start record to different time amount 
simultaneous. 

[0055] Capture equipment 102 a-c gains the time stream of various media, and generates an event in a certain instance. 
Capture equipment 102a generates a time stream and the event data 107. In an embodiment suitable at present, the 
example of capture equipment 102a is an electronic feltboard like the product LiveBoard (trademark) of LiveWorks 
(trademark) of California and Xerox Company (Xerox Company) of San Jose to available marketing. The time stream 
data gained from LiveBoard is generated in asynchronous as an interaction occurs. An event may be similarly generated 
by the call of a predetermined function (it is modification of a page on LiveBoard). 

[0056] Capture equipment 102b generates the time stream 108. In the capture equipment of such a mold, capture 
equipment is in the mode in which time stream data is gained continuously. The typical examples of capture equipment 
102b are video and the recorder of an audio. Another example of such capture equipment 102b is a pointer. Pointer 
capture equipment gains a motion of the laser pointer typically used between presentations, in order to point to 
something on a pointer, for example, the projected slide, or other vision members. Pointer capture equipment is useful 
especially because of the presentation of a positive type, when the material generally seen is prepared beforehand. 
Playback of a pointer time stream shows a motion of the pointer between playbacks of a presentation in this way. 
[0057] Capture equipment 102c only generates an event 109. The example of capture equipment 102c is a carbon 
button. A carbon button is equipment which relates generation of the event of a carbon button time stream with the user 
who operates a carbon button. A carbon button event may be generated by the user in order to point to initiation of an 
interested topic, an especially useful dialogue, and the various activities [ like ] from which a topic switches. Another 
example is a slide projector. The event in a slide projector time stream points to modification of a slide. 
[0058] Capture equipment 102 a-b gains a time stream in a digital format suitably. In order to make easy direct and 
random access to the various portions of a time stream, it is desirable to accumulate a time stream in a digital format. 
However, it is within the limits of this invention to gain and store time stream data in an analog format. The format of a 
time stream corresponds to the capture equipment used in order to generate a time stream. For example, although the 
time stream of an audio consists of the sample of the audio of the lot taken at a certain regular gap, on the other hand, it 
is the history file of the primitive actuation (explained to the following details) to which the time stump of the 
LiveBoard time stream was carried out. management of the gained time stream data is what kind of method - an 
imitation ~ it is the method of regarding it as their being the most suitable, and is carried out by the various media 
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servers which can be chosen in order to store those data. 

[0059] Generated temporary data is stored in session are recording equipment 103. Session are recording equipment 103 
offers are recording equipment eternal about the mold with which data differed, i.e., session data, event data, and time 
stream data. In fact, different physical are recording equipment distributes and session are recording equipment 103 is 
managed with the component with which time stream architecture (it states below) differed. 

[0060] Similarly, a temporary data analyzer 104 is connected with session are recording equipment 103. A temporary 
data analyzer 104 is a processing means (for example, system based on a computer) used in order to analyze temporary 
data 1 1 1, in order to identify an event 110. Event information is accumulated like session are recording equipment 103. 
[0061] Access to the recorded session is attained by the session access workstation 105. This access can be made into 
direct continuation through a network (with for example, client-server architecture). The access session starting module 
109 performs various "housekeeping" functions required in order to reproduce a session. Functionality of an access 
session starting module is typically performed by the session access workstation 105. The session access workstation 
105 is a computer control mold display system typically, and the control to session playback is attained by the graphic 
user interface displayed on the display there. Such a graphic user interface is described below. Setting in the suitable 
embodiment at present, a session access workstation is SUN of California and Mountain View. Microsystems Sun 
equipped with the available X- Windows graphic user interface from Inc. OS SUN by which 4.1 operating systems are 
performed It is SparcStation-10. 

[0062] Furthermore, the player 106, the playback control unit 107, and the editor 108 are connected with the session 
access workstation 105. Various players, a playback control unit, and each of an editor are unified in a session access 
workstation. Then, playback of an electronic feltboard time stream is attained by the 1st window on the display of a 
workstation, a video time stream is attained by the 2nd window on the display of a workstation, and an audio time 
stream is attained by the audio subsystem of a workstation. However, it will be clear to this contractor that a player does 
not need to be unified in a session access workstation and it can consider as the regenerative apparatus according to 
individual. Furthermore, in a suitable embodiment, a single window can perform a player, a playback control unit, and 
the function of an editor at present. The functionality which accompanies the organization of a window and them in a 
suitable embodiment at present is stated to details below with reference to drawing 3 . 

[0063] Finally, new temporary data 112 generated by use of an editor is stored in session are recording equipment 103. 
[0064] The main functions of LiveBoard in a joint activity are offering "a share expression" which each user's can see 
and can act mutually. LiveBoard and its OPERETINNGU software should be noticed about being designed as such "a 
share expression" does not need to be on single LiveBoard equipment. Much LiveBoards(es) can connect together via a 
network so that it may be carried out in the physical location where actual joint activities differed. 
[0065] an operative condition suitable at present — LiveBoard which was used, having set like is a means for mainly 
generating an index to session record ~ as — it does not have intention. However, LiveBoard has the peculiar capacity 
used as the useful tool for controlling the playback next to the session which had it recorded so that details may argue 
further below. LiveBoard operates under control of Tivoli application. Tivoli application Pedersen, E., KMcCall, T. It 
Moran(s) and reaches. F. ""Tivoli:An by Halasz Electronic Whiteboard for Informal Workgroup Meetings" and 
Proceedings of the lNTERCHI f 93 Conferenceon Human Factors in Computing Systems, pp.391-389, April It is 
explained to 1993 at details. 

[0066] Tivoli has the user interface similar to the class of a "drawing" program and the image generator known. A paint 
program generates and operates an image like the collection object of a graphic object. A Tivoli drawing is drawn as a 
graphic object. A graphic object contains the following. 

- Stroke : "digital ink" OBUJIEKU generated with the pen input unit. 

- Alphabetic character : it was generated via the keyboard or was carried in from the text file. 

- An image / icon object : it was copied or it was carried in. 

- Structuring object : it was carried in from the data base. 

- Clock : it is generated with clock gesture. A clock is a special mark generated on LiveBoard which appears as a round 
analog clock dial face showing between the generate time. 

[0067] Tivoli maintains the hysteresis list of performed primitive actuation. For example, the object which adds an 
object, which generates the object which deletes an object and which changes an object is chosen, or a page is changed. 
The time stump of all the primitive actuation of a hysteresis list is carried out, and it is related with an object. This 
hysteresis list is analyzed in order to identify an event so that it may be stated to details below. 

[0068] The graphic object which appears in LiveBoard is a method similar to whether it is made between the courses of 
a meeting, and actuation of opening the word processing file on a personal computer, and can be made into either of 
whether it is loaded from a certain memory data medium (for example, floppy disk). The instance of this latter, is 
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especially useful when a session is a presentation of a positive type. 

[0069] Another, important aspect of affairs of actuation of LiveBoard is use of gesture. Although gesture is generated 
like "an ink stroke (inkstroke)" of other arbitration, it is an interaction with LiveBoard interpreted as a command (for 
example, editing command). For example, if the specific object "should be deleted", an object will be chosen with the 
gesture surrounded with a pen, and the called Delete command (for example, pigtail gesture). After deletion arises, 
when a session is reproduced in this invention so that it may be stated later while marking caused by gesture only 
already makes it LiveBoard not to appear, a "ghost" image may remain. 

[0070] As mentioned above, session are recording equipment is the functional component of the time stream 
architecture which offers the eternal are recording about the data, i.e., the session data, event data, and time stream data 
of a different mold. In fact, different physical are recording equipment distributes and session are recording equipment 
is managed with the component with which time stream architecture differed. It is most practical to divide session are 
recording equipment into a time stream data base (a session and for event data) and bulk time stream are recording 
equipment (for time stream data). 

[0071] The actual data of a time stream is stored and bulk time stream are recording equipment is just going to be 
managed. In the case of video, this consists of the bulky sequence with the long video frame compressed [ was digitized 
and ] and digitized, time stream architecture -- setting ~ management of time stream data - what kind of method -- be 
the various media servers which can be chosen in order to store those data by the method of regarding it as their being 
the most suitable are left. At present, in the suitable embodiment, although most media servers stored those data in the 
usual Unix file, the media server for other are recording devices (for example, the computer control mold VCR for 
analog are recording of an audio / video time stream) was carried out similarly. About a media server, it is also possible 
to use the time stream data base for the time stream data which can be made into the most expedient device for the time 
stream equipped with intermittent few capacity data (for example, note of the sentence made by the laptop computer). 
[0072] A time stream data base is an are recording location for storing and searching the data which systematizes a 
session and event data, i.e., all information, at a session, and describes the element of a session. A user positions a 
desired session, and a time stream data base determines which time stream is related with the session, and supports 
finding out an eclipse ****** event with a ream to a session and its time stream. A time stream data base not only 
supports perusal of session data, but should be a data base which has question capacity for alternative retrieval of a 
session and an event as it is possible. It must continue over several months and several years, therefore a session and 
event information must be accumulated in non- volatile equipment (usually disk). Since time stream architecture is 
object-oriented, an object-oriented data base is suitable for it as object are recording equipment with the durability for a 
time stream data base. In a suitable embodiment, a time stream data base is carried out on a Unix file system at present. 
[0073] Temporary date analysis is a specific thing to the information acquired by the event of the time stream which 
should be extracted, and a request. It is getting to know when the specific man speaking about one useful gestalt of an 
event in the case of the time stream of the information on an audio. Therefore, it is desirable to segment a time stream, 
since it means when a man different one is talking, to assign various segments to those who are talking two, and to 
analyze an audio stream. Therefore, these segments will express the event in a time stream. The technology for 
performing such analysis on an audio stream "Unsupervised by which both are transferred to the same grantee as this 
application Speaker Clustering For Automatic Speaker Indexing Of Recorded Audio The application number 08/No. 
226,525 under coincidence continuation entitled Data", It reaches. "SegmentationOf Audio Data For Indexing Of 
Conversatinal SpeechFor Real-Time Or Postprocessing It is explained to the application number 8/No. 226,519 entitled 
Applications." Once such analysis is performed in any case, the list of events for the time stream of an audio will consist 
of two or more data items in which each contains a time stump, a period, and a speaker identification child. 
[0074] In analysis of the time stream gained by LiveBoard, an event can be considered as the input to elimination of 
drawing of a drawing or the writing of language, page modification, a drawing, or language, the notes made to the 
existing marking, or the LiveBoard user interface of a specific command. As mentioned above, LiveBoard operates 
under control of Tivoli application. The time stream generated by Tivoli is a hysteresis list of primitive actuation which 
was recorded in temporary sequence and by which the time stump was carried out. Analysis of such a time stream is 
accompanied by analyzing the syntax of the sequence of primitive actuation for identifying a meaningful event. 
[0075] Each marking on LiveBoard is called an object. Each object has one or the event beyond it related with it. It is 
required to identify all the events connected with the object and to be provided for a user as an index to the inside of a 
session for this invention. It is required to be checked by the user and to be provided for him as an index to the inside of 
a session. Therefore, temporary date analysis in this invention identifies the various events on an object, and 
accumulates the event. An object generation event exists about all objects. An object can have an object modification 
event and an object deletion event similarly. It argues about the further aspect of affairs of a LiveBoard time stream 
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below about a LiveBoard window. 

[0076] At present, in a suitable embodiment, a session access workstation is a computer control mold display system 
which operates under control of the program instruction accumulated on are recording data medium, and is described 
with reference to drawin g 2 . When drawin g 2 is referred to, the system based on a computer consists of two or more 
components connected by bus 201 course. The bus 201 explained here is simplified in order not to make this invention 
not clear. It can constitute from two or more parallel buses (for example, an address bus, a data bus, and a status bus) 
like the layered structure of a bus 201 (for example, a processor bus, a local bus, and an I/O bus). In any case, the 
computer system contains further the processor 202 for performing the instruction offered by bus 201 course from an 
internal memory 203 (the internal memory 203 should be typically noticed about it being the combination of a random 
access memory or a ** read only memory). The program instruction for performing the various functional components 
of this invention is accumulated in an internal memory 203 working. A processor 202 and an internal memory 203 can 
be used as the component according to individual, or single accumulation equipment like a use specification integrated- 
circuit (ASIC) chip. A processor 202 and an internal memory 203 consist of the electrical circuit for performing the 
various processing facilities described here. 

[0077] The display 207 for displaying the cursor controller 206 for operating the external are recording equipment 205 
for similarly storing the keyboard 204 for inputting an alphabetic character into a bus 201 and data and cursor and a 
visual output is connected. Although a keyboard 204 is a standard QWERTY keyboard typically, it can also be similarly 
made into a keypad like a telephone set. External are recording equipment 205 is immobilization, or can be used as the 
removable MAG or optical disk equipment. Typically, a cursor controller 206 has the carbon button or switch relevant 
to it which can program activation of a certain function. Furthermore, the audio output means 208 is connected with a 
bus 201 . Typically, the audio output means 208 consists of a certain audio signal generating means (for example, 
digital-analog converter) and loudspeaker. The audio output means 208 can operate also as a player. Finally, the video 
outlet means 209 is connected with a bus 201 . Typically, a video outlet means is the processing means of marketing for 
displaying a video signal on a display 207, for example, a video board. 

[0078] Although the session access workstation is materialized on the system based on the computer which operates 
according to the programmed instruction which was accumulated in are recording data medium, this invention can be 
performed on the terminal of a fixed function, or the computer control mold display system of arbitration like 
LiveBoard. 

[0079] A session access workstation operates with reference to time stream architecture using the program instruction 
for playback and control, as mentioned above. Drawing 3 is the simplified state diagram explaining fundamental low- 
level actuation of a session access workstation. When drawing 3 is referred to, a session access workstation is in the 
initiation condition 301 at first, when the request which reproduces a session is received. Subsequently, it goes into the 
session starting condition 302. The session which should be reproduced is chosen by the user between the session 
starting conditions 302. Temporary data of the selected session is searched and various players, a control unit, and an 
editor are synchronized. Various players should be noticed about the ability to also consider as the equipment which 
unified or divided them into the physical equipment same as a session access workstation. Subsequently, various 
windows (namely, a player, a playback control unit, and an editor) are displayed on the display connected with the 
session access workstation. It goes into the condition of having been named the "actuation" condition 303 at this time. 
The session access workstation is performing the interaction, and the operating state 303 described here is used in order 
to tell intention that the various functions of the user interface about a session access workstation can be called at any 
time. In any case, when it goes into the "actuation" condition 303 first, the queue for reproducing a session from the 
start is given to a session. While being in the "actuation" condition 303, various primitive functions are performed 
according to a user input. The call of a "playback" command or an equivalent graphic user interface input (for example, 
click on a specific icon) will cause initiation of a session (box 304). Thereby, a playback condition is set to "playback." 
The call of a "halt" command stops playback of a session and a playback condition is set to "a halt" (box 305). The call 
of the "display correction" command in a specific window or control makes a window correct (box 306). Such 
correction can change the truck displayed with a time-line interface. The call of playback control makes a reproducing 
point change (box 307). This gives a queue at a new point and causes playback of a session. The call of an editing 
command causes either correction to existing temporary data, or generation of new temporary data (box 308). The return 
to an operating state 303 arises by initiation of the actuation in various conditions. 

[0080] Actuation of such a large number should be noticed about that it may be called, in order to attain a specific 
function on a session access workstation. For example, the actuation which chooses the object of a LiveBoard window 
can call correction" for "display following "a halt." 

[0081] While being in operating state 303, the call of a "leaving" command makes an access session finally stopped 
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(idle state 309). 

[0082] Drawing 4 explains the screen display of a session access workstation. The screen display of drawing 4 shows 
two or more windows currently opened to coincidence. About almost all the graphic user interface-oriented window, the 
size of a window and arrangement are a user's selection matters. It is displayed on coincidence the LiveBoard window 
401, the video window 402, the time-line interface window 403, the note window 404-405, the window 406 of an audio, 
the multimedia edit window 407, and the meeting player window 408 that drawin g 4 is referred to. The LiveBoard 
window 401 can operate as an editor as a player and a playback control unit. As a player, it is used in order to reproduce 
a LiveBoard time stream. As a control unit, it enables control to playback of a session through an interaction with the 
object displayed there (it states to details below). As an editor, a user can make the specific comment about the session 
which generates a new object or is displayed by the playback next to a session. 

[0083] The video window 402 is a player used in order to reproduce the time stream of video. The note windows 404 
and 405 are players used in order to reproduce the note which can be used as a laptop computer usable as capture 
equipment between the courses of a meeting, or the same equipment. 

[0084] The meeting player windows 408 are a player and a playback control unit, using the event of temporary data of 
an and also [ it is versatility ], the meeting player window 408 offers the simulation of the dynamics of a meeting as it is 
reproduced. Playback is controlled by the interaction with the various icons which appear in the meeting player window 
408. A meeting player window is stated to details below. 

[0085] The audio window 406 is a control unit used in order to control the sound volume of the speaker for playback of 
the time stream of an audio, especially audio playback of a session. 

[0086] The multimedia editor 407 is an editor used in order to generate the note which can be introduced and returned as 
a time stream at a session, an event, or other information. Furthermore, the multimedia editor 407 can be used in order 
to generate the multimedia document which sees and does not need the session access workstation of a sake. 
[0087] The time-line interface window 403 is a playback control unit. The time-line interface window 403 is concretely 
expressed as they generate the view based on a temporary thing of an event between sessions. The time-line interface 
window 403 is stated to details below. 

[0088] The time-line interface of an embodiment suitable at this time of this invention offers playback control by the 
interaction with the expression of an event in alignment with the time line. Any of a fixed period or a period 
indeterminate (between generate times is important) are sufficient as an event. Event data is loaded into a session access 
workstation during session starting. Event data is used in order to generate the visual indicator by which contraction 
scale adjustment was carried out on the time line. These visual indicators can be used as an index point of moving 
playback to the time amount to which a session corresponds directly. The internal structure for organizing event data to 
a time-line expression is described here. 

[0089] The loaded event data is organized in order to make a user control event data by the easy method. This 
organization is defined by a mold map, an event menu, and the truck map. All event molds have the identifier of the 
layered structure called Htypes. for example, : — the mold map which the 

Speaker/AdamLiveBoard/Edit/MoveButton/BettyNote/Laptop/Charlie user defined is used in order to generate such 
Htypes. A mold map is the set of the Ruhr which uses the parameter of each event and makes Htype. Subsequently, the 
set of Htypes is prepared into the event menu of the easy layered structure shown to a user in the label area of time 
amount truck area. All events can be displayed on a user on a truck. A layout is defined by the truck map. A truck map 
is a list of two or more trucks with the list of Htypes expressed on the truck with which each corresponds. 
[0090] A visual indicator is generated about each Htypes. Although what kind of graphic style is sufficient as a visual 
indicator, most generally the class of two outlines of a visual indicator is used. The 1st class is called a segment. Since it 
corresponds to the period which an event produces, size adjustment is carried out on the time line, and a segment is 
displayed as a box of the rectangle by which contraction scale adjustment was carried out. The 2nd class is called a start 
point. A left end is located at right angles to the point of time amount that the event started, and since it means that the 
activity corresponding to an event in a right end continues indefinitely, these are displayed as a triangle "points out" out 
the right. About such an event, there is no interest about the period of an event (for example, event which shows that 
people begin to take notes). Various actuation can be performed about a visual indicator. Actuation of a visual indicator 
contains the following. 

- Generate a visual indicator (a predetermined mold or mold by the default). 

- Choose a visual indicator. 

- Remove a visual indicator from selection. 

- Move a visual indicator to a different truck (time amount is still the same). 

- Copy a visual indicator to a different truck (time amount is still the same). 
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- See much more much information about the event expressed by the visual indicator. 

- Edit the display parameter of the selected visual indicator. 

- Edit visual indicator time amount. 

- Adjust visual indicator start time. 

- Adjust visual indicator (segment) end time. 

- Adjust a visual indicator time amount location. 

[0091] Drawing 5 explains the fundamental area in a time-line window. When drawing 5 is referred to, the time-line 
window 501 consists of two or more display area. The general- view time amount truck area 502 is used in order to offer 
a general view of a session, and there is less focal time amount truck area 503 than the whole session, or it offers much 
more detailed information over an equal period. It should be careful that actuation of each truck area can offer 
temporary information on the same mold. A difference is the scale of the details (namely, a part of whole session pair 
session) which information means. 

[0092] The clock area 512 was defined in the general- view truck area 502, and the clock area 513 was defined in the 
focal time amount truck 503. In order to show the corresponding time amount span and corresponding scale of time 
amount truck area, each clock area 512 and 513 expresses clock time amount and a mark mark. The general-view time 
amount truck area 502 defined the special truck called the focal truck 508 in it. The focal segment 509 is on the focal 
truck 508. The focal segment 509 corresponds to the period of the session explained in full detail in the focal time 
amount truck area 503. Furthermore, label area relates to each truck area. Each label area is a thing which identifies the 
"truck" displayed in corresponding time amount truck area and which is accumulated and boiled. The label area 504 is 
equivalent to the general-view time amount truck area 502, and the label area 505 is equivalent to the focal time amount 
truck area 503. The relation between the general- view time amount truck area 502 and the focal time amount truck area 
503 is shown by the focal area 507. It is made for this relation to look clear by the eye by the arms 510 and 511 which 
spread from the end of the focal segment 509 to the end of the focal time amount truck area 503. 
[0093] Similarly, it is the carbon button area 506 which drawing 5 explained. The carbon button area 506 is the static 
area containing the "software" carbon button for calling various playback control functions. Such a carbon button is 
called by the method of pointing at and clicking by using a cursor controller. Arrangement and the function of a carbon 
button and it has the intention of offering easy access to the specific function generally used. 
[0094] Used by it, since a carbon button 520 skips playback for 10 seconds and makes it return, a carbon button 521 
skips playback for 10 seconds, and makes it postpone. The arrow in which the direction of the carbon button group 522 
is shown is prepared for the migration according to the context, or scrolling. A carbon button 523 is prepared in order to 
suspend playback of a session. A carbon button 524 begins to reproduce a session. A carbon button 525 makes it 
possible to skip to the next event after the set of the selected truck or the selected truck. A carbon button 526 is prepared 
in order that close may correct to the edit mode a time-line interface or the visual indicator displayed on it. The carbon 
button group 527 is prepared for the deletion according to the context, or copy (for example, a visual indicator is copied 
or deleted). The carbon button group 528 is prepared the escape according to the context, or in order to fold up (for 
example, the set of the truck which folded up the set of a truck into the single truck, or was folded up is expanded). A 
carbon button 529 is used in order to display a session menu. A session menu enables him for a user to load data for a 
session, and to save a session, or to stop a session. 

[0095] As described above, a part of session shown in focal time amount truck display area is shown by the focal 
segment contained on the focal truck of general-view time amount truck area. As for a focal segment, size is corrected 
by the user in order to change a focal span in focal time amount truck area. This is explained by drawing 6 -7. In 
drawing 6 , the focal segment 601 shows a part of session shown in the focal truck area 602. Other visual cues which 
identify this relation include the change to each clock area 603 and 604, i.e., the mark mark about time amount truck 
area and each initiation, size correction of end time, and a relative-position arrangement of time indicators 605 and 606. 
Similarly, in order to be shown in d rawing 6 , it is the playback time indicator 607 in which the present playback time 
amount is shown. 

[0096] Size correction of a focal segment is attained by various cursor control actuation. If the carbon button of a mouse 
is pushed in a suitable embodiment at present while cursor is located in the top at the right end of a focal segment, a 
focal segment will be extended towards migration of cursor. The left-hand side of a focal segment is also operated by 
the same method. 

[0097] Since the span shown in focal time amount truck area is increased, drawing 7 is drawing of the result on the 
right-hand side of the focal segment 701 extended by the right. As for this span that increased, a twist is similarly 
reflected in change of the clock area 702 and 703 (change of contraction scale correction of a mark mark, and the end 
time about focal time amount truck area). 
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[0098] A time-line interface can be used in order to control playback of many sessions, or in order to double a focus 
with many spans of a single session. Drawing 8 is drawing of the time-line interface for two sessions. Two sessions may 
express one half in the morning one half of the meeting of all the day, and the afternoon. Or they may express the 
occurrence from which a meeting like a weekly project examination meeting planned periodically differed. Typically, 
two sessions have a certain similarity. When drawing 8 is referred to, the time-line interface window 801 consists of two 
general-view time amount truck area 802 and 803 and the corresponding focal time amount truck area 804 and 805. The 
focal segment 806 shows the details about the span in the session corresponding to the general-view time amount truck 
area 802, and its span in the focal time amount truck area 804. Similarly, the focal segment 807 shows the details about 
the span in the session corresponding to the general- view time amount truck area 803, and its span in the focal time 
amount truck area 805. An actual truck shows that it does not need to be the same in each focal time amount truck area 
804 and 805. If they differ, separation label area is needed. Since the space of very many in display area is used, this is 
not desirable. 

[0099] Drawing 9 is the further drawing showing the details of many spans of a single session being displayed on focal 
time amount truck area. This displays many focal segments on the focal truck of general-view time amount truck area. 
When drawing 9 is referred to, while the 1st focal segment 901 has the details shown in the area 903 where it 
corresponds in focal time amount truck area, the 2nd focal segment 902 has the area 904 where it corresponds in focal 
time amount truck area. Such a display is desirable when it turns out that a certain area without the interest to reproduce 
exists (for example, when it turns out beforehand that the argument on the specific page on LiveBoard was considered 
[ "hold" ]). Focal time amount truck area is equally divided into two focal segments on the same scale by the default. 
However, as drawin g 10 explained, some focal time amount truck displays assigned at the session period are 
correctable. Here, it is increased to the area 1001 of drawing 10 , and the area 904 of drawing 9 was decreased to the 
area 1002 of drawing 10 in the area 903 of drawing 9 . The drag actuation which moves the left-hand side of area 904 to 
the left can perform this increment in size. 

[0100] two user taking notes according [ drawing 1 1 - drawing 14 ] to following capture equipment, i.e., Liveboard, an 
audio recorder, and a personal computer, a videocassette recorder, and the carbon button for every user - since 
change is shown on the time-line interface display about the system which changes. Of course, other combination of 
capture equipment may be used, and the event from some capture equipments is omitted and, thereby, serves as a 
different time-line interface display. The session participant about this example is named Adam, Betty, and Charley. 
[0101] When drawin g 1 1 is referred to, 1 101 of general-view time amount truck area displays the information about the 
whole session, and has the focal segment which shows the whole session. Thus, the focal time amount truck area 1 102 
displays the details of the whole session. The playback indicators 1113 and 1114 show the current playback location in 
each of those period. 

[0102] Furthermore, it is the session identifier 1 103 that it is related to the session area 1 101 . A session identifier 
identifies the session reproduced. 

[0103] The information connected with general-view session time amount truck area is offered, therefore the whole 
session includes the session start time 1 104 and the session end time 1 105. Each of the session start time 1 104 and the 
session end time 1 105 is relative time amount [ as opposed to / the actual time amount of the day when the session 
occurred can be shown, or / 0:0:0 ] ( drawing 1 1 explained like). 

[0104] The information connected with the focal time amount truck area 1 102 includes the span start time 1 106 and the 
span end time 1 107. Each of the span start time 1 134 and the span end time 1 135 is based on the actual time amount of 
the day of a specific span, or receives at the session start time 0. 

[0105] The focal time amount truck area 1 1 02 includes the truck label section 1 1 1 1 for offering the information on what 
each truck expresses. Trucks 1117 and 1118 express the edit event performed on LiveBoard. A truck 1 1 18 is generated 
according to the selection actuation performed in a LiveBoard window, and is stated to details below. A truck 1117 
expresses the various edit actuation performed by the object on LiveBoard. In a truck 1117, each edit actuation has the 
visual indicator color-code-ized peculiar. Then, red expresses deletion of an object, green expresses addition of an 
object, and blue expresses migration of an object. 

[0106] A truck 1 1 19-1 121 shows the event of an audio. A truck 1119 shows the segment about which "Adam" is 
speaking, a truck 1 120 shows the segment about which "Betty" is speaking, and a truck 1121 shows the segment about 
which "Charley" is speaking, while the participant is talking, each visual indicator of a segment is visually distinguished 
by a color or the texture typical. 

[0107] A truck 1 122-1 123 shows the start point of the note taken by Adam who is a participant at a meeting, and 
Charley. Notes were taken with the personal computer which is operating as capture equipment, or other text generation 
equipments. 
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[0108] A truck 1 124 shows the instance of the event of "carbon button 11 press. Each meeting participant has the carbon 
button which can be pushed when a participant senses that it argues about some important things. Again, a visual 
indicator is color-code-ized in order to identify the person who pressed the carbon button. As for blue, Betty means 
having pressed her carbon button there, and green means that Charley pressed his carbon button. 
[0109] A truck 1 125 shows the instance of the event about a video time stream. Such an event can include taking action 
for people talking or carrying out a certain type about a feltboard of gesture. Such an event is identified by analysis of a 
video time stream. 

[01 10] As mentioned above, the selection truck 1 1 18 is automatically generated as a result of the selection interaction in 
a LiveBoard window. The various objects (for example, language or drawing) as which a selection interaction is 
displayed on LiveBoard are just going to be chosen. Subsequently, the event about the selected object is displayed on a 
time-line window. Similarly, it should be careful that selection may arise about spatial area. In such selection, area is 
chosen and the event about the object arranged in the selected area is displayed on the time line. Since a part of session 
when marking was erased from LiveBoard is reproduced, especially this is useful (for example, the skip was performed 
between reproductive processes, and he has noticed that the object was erased, or it was replaced with another object.). 
If it returns and refers to to drawing 1 1 , various selection events will be explained. Again, suitably, a visual indicator is 
color-code-ized, in order to show the mold of an event. The generation event 1 127 shows the point of time amount that 
the object was generated, the migration event 1 128 shows the point of time amount that the object was moved on 
LiveBoard, as for the color change event 1 129, it is shown that the object color was changed, and the deletion event 
1 130 shows that the object was deleted. 

[01 1 1] A user can correct the contents of each time amount truck area. A truck can be merged, added and concealed or 
can be moved. In order to correct the contents of time amount truck area, actuation is performed in a label section. For 
example, an audio track 1119-1121 may be chosen and merged by reference of drawing 1 1 . It is explained by drawing 

12 and the merged truck 1201 is generated by the result of such a merged truck there. Selection of a truck can be 
attained by operating a cursor controller, pressing a switch for the switch relevant to a cursor controller, and moving 
cursor so that the label of a truck may be passed. Directions of selection of a label are attained by a certain visual 
stimulus which expresses the label chosen by the video mode of reverse. Discernment of the selected label is attained by 
detaching a switch. Various truck actuation options are displayed at this time. Subsequently, a user chooses desired 
actuation (in this case, merge actuation). However, this is one method of performing truck display actuation, other 
technology - a pull down menu — or it can call with the command inputted from the command line. 

- Actuation of Truck Generates - Truck Which Removes from Selection - Truck Which Chooses - Truck Containing the 
Following (Predetermined Htypes). 

- - Which Rearranges Selected Truck - Which Folds Up Truck Which Deletes Selected Truck, and of which - Selection 
was Done (into One Truck) -- [01 12] Which Edits - Truck Label into which Display Parameter of Truck Which Extends 
Selected Truck into Sequence of Truck the Htypes - being Based, and of which - Selection was Done is Edited It 
produces that the point and click actuation on a different visual indicator differed from each other. The playback next to 
a time stream is set to the time amount corresponding to the beginning of a visual indicator in each case. In the case of a 
note (Notes), the window containing the text in a note can open. Generating of such actuation is explained by drawing 

13 . When drawing 13 was referred to, the visual indicator 1301 was pointed at and the switch on a cursor controller was 
clicked. This makes the text window 1302 containing the text generated between meetings opened (here, useful 
indication was made by text" Betty.). Those with the necessity of using this argument in a meeting with a superior 
official. "). The text window should be noticed about that it may appear similarly in the location where it differed 
outside time amount truck display area. 

[01 13] The time line should be noticed about the ability to use combining other visualization technology, in order to 
show the long string of the data which could display perpendicularly or horizontally or continued. 
[01 14] The form of a player is not limited to being reproduced with the completely same gestalt as the time of it of 
temporary data of a session being generated. The example of such a player is a meeting player. A meeting player is used 
in order to express various meeting dynamics so that it may be visible. This is useful to identify a speaker although the 
voice by which people are reproduced cannot be recognized. The meeting player of this invention simulates the activity 
generated between meetings. Drawin g 14 explains the window 1400 which displays a meeting player. If drawin g 14 is 
referred to, including the visual indicator 1401-1403 with which, as for a meeting, each expresses a meeting participant, 
visual indicators 1404 and 1405 will express note taking equipment (for example, laptop computer), and a visual 
indicator 1406-1408 will express a "carbon button. 11 The icon which expresses the produced current event during 
playback is highlighted. Here, since the speaker expressed by the icon 1401 is talking, an icon 1401 is highlighted. 
Similarly, when someone pushes a carbon button, a carbon button icon is highlighted and displayed. 
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[01 15] It should be cautious of it being possible to include a speaker's very small image in a speaker's icon. It is 
desirable similarly for the visual feature as the truck with which it corresponds on the time line that each associated icon 
is the same to be maintainable. Then, if the speaker icon 1401, the carbon button icon 1406, and the computer icon 1404 
are connected with Adam who has the blue visual feature, these icons will serve as blue. However, it is admitted that 
there may also be a condition in which this is impossible for a limit of the color which can be displayed, or other factors. 

[0116] Furthermore, the LiveBoard page, the title indicator 1410, and the clock 141 1 are displayed on the meeting 
player window. A page and the title indicator 1410 show the "page" seen on LiveBoard now at this reproductive 
moment. A clock 141 1 shows playback time amount. About the fact that a session expresses a meeting, a table 1409 is 
similarly displayed, in order to offer a visual cue. 

[01 17] A meeting player can also be used in order to change playback into a different speaker. This makes it possible to 
cross a meeting easily by the speaker of specification [ a user ]. The change to a different speaker is attained by the 
actuation "is pointed at and clicked" to a desired speaker's icon. This makes playback jumped to the following point in 
time about the selected speaker. Furthermore, this actuation acts to all icons and the jump to the next instance of the 
event related with the selected icon is performed there (for example, actuation "points and clicks" a page and the title 
indicator 1410 in order to skip playback to the beginning of the next page of LiveBoard is performed.). Thus, the 
meeting player of this example operates further, in order to control playback of a session. 
[01 1 8] A meeting player may be designed so that other various events which can be analyzed may be shown. For 
example, since it means when it laughed or applause has arisen, or in order to laugh or to skip to a next temporary 
occurrence of applause, an icon 1412 or the "laughter" "applause" icon 1413 can be offered. Furthermore, although a 
suitable embodiment is used in order to express a meeting, it is the same method and can express the activity of other 
molds, for example, a presentation. 

[01 19] The suitable LiveBoard window of an embodiment operates to coincidence as a LiveBoard time stream, a 
playback control unit, and a player of an editor at present. A LiveBoard window is based on the above-mentioned Tivoli 
software. A LiveBoard window operates by different playback mode. Namely, it is in the ANIMETEDDO mode which 
reconstructs the exact appearance of the past condition, and "BAUNSHINGU-ball" mode and "Naru (null)" mode in 
which cursor points at the area where marking/edit has broken out. In ANIMETEDDO mode, a LiveBoard window is in 
the recorded sequence and reproduces a LiveBoard time stream (namely, hysteresis list by which the time stump was 
carried out). In "BAUNSHINGU-ball" mode, the condition of LiveBoard in the end (or exit status of a page) of a 
session is displayed, the event related to an object occurs, an object is highlighted, and cursor points. In 
"BAUNSHINGU-ball" mode, the form of cursor changes in order to show the mold of an event (for example, rubber for 
deleting the hand for moving the pen for generating an object, and an object, and an object). In the "Naru" mode, the 
exit status of LiveBoard in the end of a session (or exit status of a page) is displayed. NARUMODO is used when 
renewal of a LiveBoard window is not desirable (for example, it perplexes a user). 

[0120] In each playback mode, the feature of the addition called a ghost leaves the faint version (the ghost) of an object 
on a display, also after it is deleted. This feature can be turned on and off by the user. A ghost object can be used as an 
index to the inside of a session. 

[0121] Animation mode and BAUNSHINGU-ball mode show the mold of the event respectively produced in specific 
time amount. In BAUNSHINGU ball mode, although cursor tells the mold of an event, in fiill animation mode, 
animation shows the mold of an event by ANIMETO [ it ] how. 

[0122] Playback control is produced by the interaction with the object displayed between playbacks. As an easy 
example, a user can choose an object and can call a playback command directly on LiveBoard (for example, time 
amount written on LiveBoard). The feature of other playback control is described below. 

[0123] Since the function of all LiveBoard(s) can be used, a LiveBoard window can operate as an editor. Then, a user 
can operate these selves of the displayed object, or can add a drawing. Such actuation makes the time stream of these 
selves generated. 

[0124] A LiveBoard window is important for operating as both a player and a playback control unit. With a known note 
taking system, a LiveBoard window offers the playback control means which is not strictly based on the exit status of 
note taking data medium on the contrary. A user can act on LiveBoard and mutual all the points between playbacks. He 
can notice that the user reproduced the session, and skipped to the point of them of a session (for example, the point and 
click actuation on a clock), and language was erased from LiveBoard there. This can carry out the trigger of the user, in 
order to consider a part of playback in relation to deletion of language in details. 

[0125] Drawin g 15 explains the LiveBoard window of a suitable embodiment at present. When drawin g 15 is referred 
to, the LiveBoard window 1501 is performed on a session access workstation, and is the instance of the user interface 
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for Tivoli application. A LiveBoard window consists of the control area 1502 where both sides touch the object area 
1503 in a boundary. Various control of the control area 1502 is active in the LiveBoard window 1501. An active and 
selectable object is marking displayed on the object area 1503. Similarly, the playback tool 1504 is explained. In the 
point which has relation in the selected object, the playback tool 1504 is used in order to begin playback. 
[0126] The example of an interaction with LiveBoard for choosing an object on account of the generated hysteresis list, 
and asking the earliest point to it is possible. As mentioned above, a hysteresis list is a list of performed primitive 
actuation, the time stump of each primitive actuation is carried out, and it is related with an object. The object was 
defined spatially typically and performed as a function. For example, a line is drawn from points XI and Yl to X2 and 
Y2. Then, when selection of an object is made, it is easy to see a spatial location, to find out the object of the location, to 
find out the primitive object relevant to an object, and to choose the time amount of the subsequently most remarkable 
event. The most remarkable event is a "generation" event when general. However, since other time amount may make a 
user cause interest, the selection actuation whose user can choose the most remarkable event (explained below) is 
offered. 

[0127] A LiveBoard time stream can be generally classified into two molds, i.e., monotone and non-monotone. A 
monotone time stream mainly has a "generation" event. The happening only thing is what a new object is generated for 
(there are not migration, modification, and elimination). In a monotone time stream, a large majority of overwhelming 
objects have only one event relevant to it (the generation event). 

[0128] A non-monotone time stream consists of generation, modification, migration, and a deletion event. Thus, each 
object can have one or more events relevant to it. It is useful to distinguish change (namely, migration) from which the 
location of an object changes, and change which is not so. If the time stream does not have any location change events, 
each object has the only location in a display top. If there is a migration event, an object may occupy much locations 
during a session. Finally, if a time stream has a deletion event, an object may disappear by a certain time amount 
between sessions. 

[0129] A Liveboard window is a stand-alone or can be used as a playback control unit correlated with the time-line 
interface. The correlation with a time-line interface is described below. In stand-alone mode, selection of an object and 
the call of a playback tool (playtool) will cause the playback in the time amount of the "generation" event about an 
object about a monotone time stream (this is because it is the only event connected with the object). 
[0130] It is what "event" in the case of a non-monotone time stream, a problem uses, in order to start the playback time 
amount of the selected object. If a user points at an object with a playback tool, a system will reproduce the session of 
the stage of the reasonable early event relevant to an object. However, other time amount about an object may be 
important. For example, the time amount to which the object was moved may be important. There is an option which 
accesses other event time amount about an object. For example, the event menu which made all the events relevant to an 
object the table is offered. The playback whose user only chooses a desired event starts in the time amount relevant to 
an event. 

[013 1] the technology of an exception is using the event [ degree ] playback carbon button which skips playback time 
amount to the following event relevant to a current object. Still more nearly another technology using time-line 
functionality is expressed below. 

[0132] The idea of the clock in a Liveboard window on LiveBoard was mentioned above. Since a clock offers 
temporary reference of when the activity broke out in the Liveboard window, it is useful in the case of playback of a 
session. The clock should remember that it is the graphic object generated by clock gesture. A clock can be operated and 
edited in the same way as all graphic-arts objects. However, the clock object is special and it includes a special property 
in the data structure expressing its "internal" time amount. [ of itself] If a playback tool touches a clock, a reproducing 
point will be set to the internal time amount of a clock, and will not be set to the time amount (for example, between the 
generate time) of some events relevant to a clock. Therefore, a clock can be used in order to deal with it as time amount 
which became independent of the hysteresis of itself. By the default, the internal time amount of a clock is the same 
time amount as generation actuation of a clock. However, it comes out so, a certain necessity is not, and this draws 
various useful functions. 

[0133] The internal time amount of a clock is changeable. At present, if edit gesture (it points now and holds) is 
performed on a clock in a suitable embodiment, the menu into which a user can change the internal time amount of a 
clock will pop up. These change can be made into relative (for example, only N second moves internal time amount to 
the front or back), or either [ being absolute (that is, internal time amount being moved to the specific time amount T) ]. 
Since the former is much more exact when adjusting slightly the internal time of a clock, in order to attach an index, it is 
the most useful. 

[0134] For example, in a meeting, it takes up and argues about an interesting problem. The user of LiveBoard can attach 
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an index to this discussion by generating a clock and writing a note. However, after discussion starts, a clock is usually 
generated to some extent behind. Therefore, a clock can be edited, in order to attach an index to initiation of discussion 
much more correctly and to adjust the time amount to hard flow slightly. This edit can be carried out between access 
sessions between meetings or in the back. Since the latter is convenient to reproduce a meeting from current clock 
setting in order to distinguish whether setting is exact, it is the most useful. In current operation, facilities are given to 
the user by making playback start, after edit is performed, and feeding back the validity of time amount setting to a user 
to a user immediately. 

[0135] A user can generate a clock between access sessions by adding a clock via a LiveBoard window (seeing the 
LiveBoard window as an editor hereafter). However, it sets in this condition, and the internal time amount of a clock is 
set to the current reproducing point of a playback tool, and is not between that generate time in an access session (it is 
not useful at all). For example, it thinks of the user who accesses a still earlier meeting. He hears the audio of a meeting 
and hears the important idea which was not able to attach an index between meetings. Then, in respect of [ this ] 
playback, he generates a clock and, subsequently to that next door, types a note. This clock is a new index to a meeting. 
Therefore, the quality and the amount of index addition can be strengthened in the access time by enabling it to generate 
the object holding the time amount in an original meeting. 

[0136] It is often desirable to see all the events relevant to an object. For example, a user may desire to get to know the 
existence and the stage of modification of an object, or deletion. As mentioned above, all the events relevant to the 
object chosen by LiveBoard are displayed on the selection truck of a time-line interface. This offers the means for 
displaying the index to the inside of a session with the relation which the user specified by the functionality between 
LiveBoard and a time-line interface. 

[0137] Other features of the interrelation by the interaction with a LiveBoard window are explained by the scenario of 
the following described about drawing 16 - drawing 20 . The expression of a LiveBoard window and a time-line 
interface should be noticed about being simplified. Especially the control area on a LiveBoard window and the general- 
view time amount truck area of a time-line interface are not shown in drawing. 

[0138] Reference of drawing 16 wants conversation when this language is written for a user to look at language in the 
LiveBoard window 1601, and to be reproduced. A user chooses the "redundancy" of language 1602 using a suitable 
selecting technic (gesture which surrounds language with a circle here using a pen/mouse). Subsequently, the time-line 
interface 1603 is updated on a selection truck, in order to show all the events connected with the selected language. 
Here, a visual indicator 1604 is displayed on the selection truck 1605. A visual indicator 1604 expresses the event which 
writes in language, the event of others [ this example ] - language - [0139] which is not associated as it is "redundant" 
Similarly, the playback time indicator 1606 is explained by the time-line interface 1603. Then, playback should be 
shortly noticed about it being the point after [ "after" ] language "redundancy" was written. 

[0140] Drawing 17 explains the synchronization between a LiveBoard window and a time-line interface. A user moves 
the playback time indicator 1703 within the time-line interface 1702 just before a visual indicator 1604. Subsequently, 
the LiveBoard window 1701 is updated in order to display exactly what suited on LiveBoard then. When especially 
compared with drawin g 16 , language "redundancy" should be noticed about not appearing in a LiveBoard window. 
[0141] If a playback command is called, both a LiveBoard window and a time-line interface will be updated 
synchronously. After a while, language "redundancy" appears in LiveBoard. 

[0142] Here, a user notices that some events were on the time line just before the event on a selection truck. A user 
chooses the visual indicator expressing these events on the time line, and the element with which the drawing 
corresponds is immediately highlighted in a LiveBoard window. That is, the interrelation of a drawing and the time line 
is bidirection. 

[0143] This is explained by drawin g 18 . A visual indicator 1 804 is chosen from the time-line interface 1 803. In the 
LiveBoard window 1801, language "router (router)" 1802 are highlighted (here, the circle of a dotted line showed). 
Therefore, the event corresponding to a visual indicator 1804 is related with language "a router." 
[0144] Next, a user looks at a thick box on drawing of a Liveboard window. And a box is chosen. Three visual 
indicators are displayed on the selection truck of a time-line interface (or three visual indicators can be highlighted on an 
edit truck). The visual indicator of the 1 st mold shows the generation event for a box, the visual indicator of the 2nd 
mold shows the Rhine width-of-face modification event, when a box is made thick, and the visual indicator of the 3rd 
mold shows the event of migration of the box on a drawing. As described above, the visual indicator after a time-line 
interface is visually distinguished, in order to show the class of event which they express. A user is interested in the 
reason nil why a box is thick, moves a time amount marker to the Rhine width-of-face modification event, and calls 
playback using a playback tool. 

[0145] This is explained by drawing 19 . A box 1902 is highlighted in the LiveBoard window 1901. A visual indicator 
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1904-1906 is highlighted with the time-line interface 1903. As mentioned above, each of these visual indicators 
expresses the specific mold of the event relevant to an object. Furthermore, in a suitable embodiment, each visual 
indicator has a color at present on a certain visual property of corresponding to the mold of an event, and a type target. 
[0146] A user starts either playbacks or chooses a visual indicator 1904. 

[0147] Next, a user considers drawing on another page of a drawing. Between meetings, this drawing is drawn 
repeatedly, is erased, and is redrawn, and a user wants to hear why a former version was not considered to be the right. 
A user chooses the area of a drawing in which drawing is located. Here, some sections of the time line are highlighted 
and the event about all the objects that suited the area of drawing containing the object deleted or moved becomes clear. 
A user moves a time amount marker to the visual indicator of deletion with which the 1st was highlighted, and finds the 
argument of why the 1st version was changed. 

[0148] The visual cue which the object came to become in a specific location is a ghost object. A ghost object is the 
faint outline of the object used in order to show that the object existed in this specific location in the point of a certain 
time amount during a session, the user has noticed various object ghosts and what was there — or it wants to get to know 
whether it will be (for example, list of items with which it becomes clear by the ghost object that the item was erased in 
the end of a session). 

[0149] This is explained by drawing 20 . When drawing 20 was referred to, the user chose the area 2002 of drawing of 
the LiveBoard window 2001 . If drawin g 16 is referred to simply, area 2001 is equivalent to the list of language, 
"addition", a "router", and area including "redundancy." The time-line interface 2003 has the visual indicator 2004-2006 
of a large number highlighted here. These are related to "the event corresponding to the event relevant to area 2002, i.e., 
language, "addition", and a router", and the event related redundantly. This should be cautious of it being only spatial 
correlation, i.e., the event expressing the language erased from the list having been highlighted similarly. Furthermore, 
the "ghost" object 2007 is explained to drawing 20 . 2007 was erased for the object of the location shown by the "ghost" 
object 2007 in respect of [ this ] playback. 

[0150] As mentioned above, an editor allows a user to add a time stream and event data after the fact. It is marking on 
LiveBoard (or added new marking) when a LiveBoard window is used as an editor or what is edited. In this case, 
addition to a LiveBoard time stream and/or deletion are performed as a result of such edit. Moreover, another time 
stream is also generable. 

[0151] When used as an editor, a LiveBoard window offers a very effective means by which the session when the non- 
participant was recorded can be examined efficiently. Partially, this is because it can use during playback of all the 
fundamental capacity of LiveBoard of a session. This is best described about drawing 21 and drawing 22 which show 
the LiveBoard window in the end of the session of both before and behind an editing session. LiveBoard of this example 
is operating by the BAUNSHINGU ball playback mode. 

[0 1 52] If drawing 21 is referred to, marking of various handwriting has appeared in the LiveBoard window 2 1 0 1 . As 
mentioned above, marking of these handwriting of each can be used in order to attach an index into a session. However, 
between a certain meetings, some of marking may be unrelated (for example, mark 2102), or it may be hard to decipher 
them (for example, mark 2103). As [ accomplish / to LiveBoard / furthermore, / although there is an important point 
about which it argued / nothing ] 

[0153] Drawing 22 explains the LiveBoard window of drawing 21 after someone edits. When drawing 22 was referred 
to, the edited LiveBoard window 2201 was extended in order to make it adapted for the notes accomplished with the 
editor. The edited LiveBoard window 2201 inserts a text using a clock, and offers much more much an index and 
information. In drawing 22 , since it meant what is discussed by the point, the text was related with each clock. Since it 
means what a mark 2103 means, a text 2203 can be used there. A clock / text 2202 means what collection of marking 
expresses, and when generation of marking started. Clearly, the edited LiveBoard window enables the next viewer to 
use a LiveBoard window much more effectively as a playback control unit. 

[0154] As an editor, marking which exists on a LiveBoard window is changeable. This can be performed in order to 
erase the unrelated marking 2102, for example, marking of drawing 21 , so that the next viewer's of a window attention 
may not be distracted. 

[0155] Another aspect of affairs of time stream architecture is control to the gained time stream, the time stream from 
which the user was gained ~ especially - an audio and video - like - " - it is very interested in the time stream which 
is record of "literally. They are interested in who accessed their activity and literal record of conversation. They are 
interested in they being recorded when and getting to know **, and they desire control to this. After the argument which 
was not recorded on the other hand although it was interested, a user will fly, if it carries out and they are recording it, 
and he is ******. 

[0156] User control is supported by time stream architecture. However, operations are between the captures of a session, 
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and after that [ both ], and need the user interface tool for giving a user control effectively. 

[0157] the handling with a "control event" special [ time stream architecture ] ~ providing . A control event is - time 
amount span (time amount and a period are made to start) which specifies the following. 

- Class of Time Stream-Control Which Should be Controlled (Purge Level of Protection) 

- It is [0158] when Control Becomes Effective. Supposing the gained session can have many time streams, a control 
event can control them alternatively. For example, it is useful to control only the audio between the delicate spans of an 
argument. A control event can also specify all the time streams of a session. 

[0159] There is some kinds of control. The recorded data can be physically purged from a data base. Access to whether 
the recorded data are heard and it seeing can be refused, or can be given to the group of a specific user or a user. Access 
can be used as a different mold like access which can only be read, access which can append new data, access which can 
edit data completely, or access which can change an access control. For example, only the chairperson of a meeting can 
edit meeting record, only a group's manager can change an access control and a control event can append it to the data 
by which only the participant at a meeting had new data gained, and as the audio from which only other individuals of a 
specific group were gained has been heard, it can be specified. 

[0160] Finally, the timing of control can be specified. This is the most useful in order to purge, if the acquired record 
describes a detail - immediately (for example, in order to erase an argument of the whole personnel) - immediately 
after a session (for example, in order to erase the meeting which does not excite interest) » or it can purge to different 
time amount like [ of a number of days or how many months after ] (to for example, document arrangement and storage 
management sake). However, to a non-participant, access to meeting record can be refused for one week, and it can also 
be specified that it gives the time amount of editing record into the chairperson. 

[0161] Although time stream architecture enables a control event to specify various control, architecture does not carry 
them out directly but represents the control to the various components of architecture. In order to carry them out, it can 
code appointed [ many of ] in a data base. A time stream player and a time-line interface also serve as assistance which 
carries out a certain access control similarly. Purging must usually be carried out according to a recorder or a certain 
process which understands the data format of a specific time stream. The process to purge can be made into either of 
whether record is compressed whether overwrite of the data which should be purged is carried out, and by keeping 
outside the data which should write in again and should actually be purged taken out "it burying by zero." Although 
time stream architecture does not guarantee perfect operation of a control event in itself, it performs the best thing which 
can be performed with an available component in the given condition. 

[0162] It turns out that it is generally very delicate to offer an access control by the method based on time amount. For 
example, since delicate decision is dealt with, I consider purging the audio / video record of the argument on the span 
for 10 certain minutes, and think that video record shows the feltboard of a wall. Even if the span for 10 minutes is 
purged from video, there will be no guarantee that the remainder of the discussion does not remain on a feltboard after 
the span. However, the control based on time amount is useful as a practical problem at almost all time amount. 
[0163] The control event is useful, only when a user can generate them easily and can edit them. For a user, it is natural 
to specify a control event with a time-line interface after a session. 

[0164] At present, in a suitable embodiment, in order to give a user control of the duplicate eye to record of the audio 
during a session, the easy set of a user interface tool is offered. It is important to make a user notice when record was 
started. A red light on a video camera performs this. About Liveboard, while record is performed, "under record" is 
displayed. [ blinking ] A user can turn a recorder on and off for both with the pause carbon button and record carbon 
button which are a hard carbon button on physical equipment, and the software carbon button after LiveBoard or a 
computer display. However, this control must be expected. That is, in order to consider as any of record and a pause, it 
must not be in a user whether it is interested or delicate, but he has to know beforehand whether it is **. In fact, this is 
not effective. That is, a user cannot often recognize these conditions after they start until it becomes behind enough. 
Therefore, posthook (post-hoc) control is needed. 

[0165] Our user interface offers this by carrying out the concept of "record ON" and "record OFF" (adding to a pause 
and record), and this enables a user to control the record after the fact by the method suitable during a session. This idea 
is that the whole session is actually recorded, a user can mark whether it is record OFF or it is record ON on the portion 
of a session, and the portion of record OFF of record is purged after a session. 

[0166] If it is made to start in order that a session may record, the blinking "record ON" cautions will be displayed 
together with a record off-carbon button. If a record off-carbon button is pushed, a user is this time or can mark that 
record is off on a session at the time of N quota. For example, if an argument turns to delicate subject and a debate 
person writes in a note after several minutes, they can set in [ of the last used as record OFF ] 5 minutes. Similarly, 
when the session is not recorded, blinking "record OFF" is displayed together with a record on-carbon button, and, 
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thereby, a user can mark that record is ON on a session. For example, when discussion becomes interesting, the last 10 
minutes can be returned after record to origin. These control insists to the end of the session when a user can determine 
whether the whole session should be recorded. 

[0167] These user interface tools 1 carrying out is making a control event generate between sessions (a record off 
segment is marked noting that it is purged, and a record on-segment is marked noting that it permits access.). After a 
session closes, a recorder is called, in order that the process which analyzes the control event made about consistent 
assignment (that is, the span of a session is marked on both record ON and OFF) may be performed and a process may 
subsequently purge record. One technology for confrontation solution is granting priority further to the latest control 
event. However, a user looks at a control event via a time-line interface, and before he calls a purge, he can ask that they 
are edited. 

[0168] It is that it is difficult for a user to know whether one difficult point of this user interface will return in order to 
change record. One amelioration to this will use the audio tool for analysis of us who give the time amount point a user 
has a meaning further. For example, after pushing a record off-carbon button, the menu of change of the backing up 
point or speaker to the pause of the latest audio can be expressed. The user was reproducible from these, in order to 
determine a right time amount point. 



[Translation done.] 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation* 

LThis document has been translated by computer. So the translation may not reflect the original precisely. 
2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DRAWINGS 



[Drawing 2] 



203 



I 



1 



204 



205 



201 



1 



206 



1 



•to — vti/ 



207 



208 



209 



* — T< * 



_y* 



[Drawing 1] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



7024 







1028 


1 








v 

V 








m 












1 



101 J 




772 



HIT 



1 



t 7 v a > 



^7<W 






110 




) 104 




) 


-Bf x-7 fc 




^777 



106 



~f \y V 



107 



105 



108 



If-I 7 



[Drawjng_3] 



http://www4ipdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



Page 3 of 22 




[Drawing 4] 



http://vmw4ipdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 4 of 22 




v 

Y\ 

K 
v 

is 













T A 




1 A 




V — ■ 

IK A 










1 v 






O 










8^ 



A | 
V H 

-4 I 

V 

<N A 
V 



A 
V 




[ Drawin g 5] 



http://www4ipdljpo.gojp/cgi-bin/tran_web__cgi_ejje 



1/28/2004 



Page 5 of 22 




http://www4Jpdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 6 of 22 




[Drawing 7] 



http://www4Jpdlopo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 7 of 22 




"K 1 



[Drawing 8] 



http://www4ipdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 8 of 22 




804 




□ e- 



t7 
3 > 



[Drawing 9] 



http://www4.ipdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 9 of 22 




[Drawing 10] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 




http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 11 of 22 




[Drawing 12] 



http://www4ipdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 12 of 22 



CO 

I 

V 



V 



I 

V 



3 - 



CO 



IK 

J 



A 



1^ 



[Drawing 13] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



WW 



2:1204 



UVBOttD 

79'k 



1 II 1 1 II 1 1 1 1 1 


1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 











OrOtO 

I 1 1 1 I 1 1 I I I I I 



I 

1:07:45 



1 II I I 1 1 1 I 



ijiiiiifiimiiiiiiiiii 



^ h 



2:12:34 



I I I 1 I I I I I I I I I I I 

H — I — HH H — H 



iiiiimmiiiiij 



3-___- 



•0 — I 



1301 



Page 13 of 22 



[Drawing 14] 



http://www4ipdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 14 of 22 




http://www4ipdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 15 of 22 




http://www4ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 16 of 22 




[Drawing 1 7] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 17 of 22 




[Drawing 1 8] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 18 of 22 




http://vmw4jpdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 19 of 22 




[Drawing 20] 



http://www4Jpdljpo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 20 of 22 




[Drawing 21] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 




http://www4ipdlopo.gojp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



Page 22 of 22 



mtmm 



■2302 



3. O rt^v ^ £c - 




2309 



5" . C rcVi^ 



V 



220/ 



[Translation done.] 



http://www4.ipdl.jpo.go.jp/cgi-bin/tran_web_cgi_ejje 



1/28/2004 



